Data Prep Studio input path wildcard

Clara

Hello all, my question is about inputs to Data Prep Studio and wildcards in the file name.

Q:

​In Data Prep Studio, when defining an input source file path, is it possible to utilize a wildcard in the path?  For Example, a file may be called 

TrialBal_123456ABC.CSV

or

TrialBal_789012XYZ.CSV

Are wildcards allowed in the pathname like  in the same way they are allowed in Monarch project source path names? 

I want Data Prep Studio to find any file beginning with 'TrialBal' and ending with '.csv' without renaming the source file.

Thanks in advance!

------------------------------
Clara
Business Analyst
IL
------------------------------

Steve_Caiels

Hi Clara,

This feature is available in Monarch Server Automation Edition, but not in the desktop software.

As you have mentioned wildcards in the project, it sounds like you may have Monarch Server (Automator)? Is that correct?

If so, you need to add a Database input to your Visual Process, edit this to include the wildcard, then edit the Workspace to use the Database input instead of the input defined within the Workspace.  This is done by working you way down the load plans in the Workspace icon in the Visual Process until you find the drop down for the original input file.  You should be able to expand this and select the wildcard version.

Regards,
Steve.

------------------------------
Steve Caiels
Professional Service
Datawatch Corporation
+44 203 868 0253
------------------------------
-------------------------------------------
Original Message:
Sent: 02-25-2019 06:42 PM
From: Clara Bonaccorsi
Subject: Data Prep Studio input path wildcard

Hello all, my question is about inputs to Data Prep Studio and wildcards in the file name.

Q:

In Data Prep Studio, when defining an input source file path, is it possible to utilize a wildcard in the path?  For Example, a file may be called

TrialBal_123456ABC.CSV

or

TrialBal_789012XYZ.CSV

Are wildcards allowed in the pathname like  in the same way they are allowed in Monarch project source path names?

I want Data Prep Studio to find any file beginning with 'TrialBal' and ending with '.csv' without renaming the source file.

Thanks in advance!

------------------------------
Clara
Business Analyst
IL
------------------------------
"

Mahmoud

Hi Clara,
A wild card is not allowed in DPS.  If you created a Workspace using the TrailBa_123456ABC.csv file, then you can use the DPS load option>Edit file path and select the other file (TrailBal_789012XYZ.csv).

If you have the Monarch Server Automator, you can create an Automator Visual Process and use a wild card (TrailBal_*.csv) to process all files that starts with TrailBal file name.
Regards
Mo

------------------------------
Mahmoud Abdolrahim
Senior Implementation & Integration Engineer
Datawatch Corporation
MA
(978) 935-3840
------------------------------
-------------------------------------------
Original Message:
Sent: 02-25-2019 06:42 PM
From: Clara Bonaccorsi
Subject: Data Prep Studio input path wildcard

Hello all, my question is about inputs to Data Prep Studio and wildcards in the file name.

Q:

In Data Prep Studio, when defining an input source file path, is it possible to utilize a wildcard in the path?  For Example, a file may be called

TrialBal_123456ABC.CSV

or

TrialBal_789012XYZ.CSV

Are wildcards allowed in the pathname like  in the same way they are allowed in Monarch project source path names?

I want Data Prep Studio to find any file beginning with 'TrialBal' and ending with '.csv' without renaming the source file.

Thanks in advance!

------------------------------
Clara
Business Analyst
IL
------------------------------
"

Mahmoud

Clara,
To assign a wild card in the file name in the Automator Visual Process perform the following steps:
First upload the workspace in the server library.
Create a Visual Process, add a database input and use a wild card in the path.
Add a workspace object to the canvas,
Connect the database input to the workspace. 
In the workspace property pane, select the database input  in the File name list.
I assumed when you used the csv fine in DPS, you used the delimited text option.  If you used the text option in DPS, then in Visual Process you should use File Input object instead of Database Input object.
Regards
Mo

------------------------------
Mahmoud Abdolrahim
Senior Implementation & Integration Engineer
Datawatch Corporation
MA
(978) 935-3840
------------------------------
-------------------------------------------
Original Message:
Sent: 02-25-2019 06:42 PM
From: Clara Bonaccorsi
Subject: Data Prep Studio input path wildcard

Hello all, my question is about inputs to Data Prep Studio and wildcards in the file name.

Q:

In Data Prep Studio, when defining an input source file path, is it possible to utilize a wildcard in the path?  For Example, a file may be called

TrialBal_123456ABC.CSV

or

TrialBal_789012XYZ.CSV

Are wildcards allowed in the pathname like  in the same way they are allowed in Monarch project source path names?

I want Data Prep Studio to find any file beginning with 'TrialBal' and ending with '.csv' without renaming the source file.

Thanks in advance!

------------------------------
Clara
Business Analyst
IL
------------------------------
"

Clara

Mahmoud said:

Clara,
To assign a wild card in the file name in the Automator Visual Process perform the following steps:
First upload the workspace in the server library.
Create a Visual Process, add a database input and use a wild card in the path.
Add a workspace object to the canvas,
Connect the database input to the workspace. 
In the workspace property pane, select the database input  in the File name list.
I assumed when you used the csv fine in DPS, you used the delimited text option.  If you used the text option in DPS, then in Visual Process you should use File Input object instead of Database Input object.
Regards
Mo

------------------------------
Mahmoud Abdolrahim
Senior Implementation & Integration Engineer
Datawatch Corporation
MA
(978) 935-3840
------------------------------
-------------------------------------------
Original Message:
Sent: 02-25-2019 06:42 PM
From: Clara Bonaccorsi
Subject: Data Prep Studio input path wildcard

Hello all, my question is about inputs to Data Prep Studio and wildcards in the file name.

Q:

In Data Prep Studio, when defining an input source file path, is it possible to utilize a wildcard in the path?  For Example, a file may be called

TrialBal_123456ABC.CSV

or

TrialBal_789012XYZ.CSV

Are wildcards allowed in the pathname like  in the same way they are allowed in Monarch project source path names?

I want Data Prep Studio to find any file beginning with 'TrialBal' and ending with '.csv' without renaming the source file.

Thanks in advance!

------------------------------
Clara
Business Analyst
IL
------------------------------
"

Thank you.  It will be several days before I try this out but I'll let you know how it goes!

 

------Original Message------

Clara,
To assign a wild card in the file name in the Automator Visual Process perform the following steps:
First upload the workspace in the server library.
Create a Visual Process, add a database input and use a wild card in the path.
Add a workspace object to the canvas,
Connect the database input to the workspace. 
In the workspace property pane, select the database input  in the File name list.
I assumed when you used the csv fine in DPS, you used the delimited text option.  If you used the text option in DPS, then in Visual Process you should use File Input object instead of Database Input object.
Regards
Mo

------------------------------
Mahmoud Abdolrahim
Senior Implementation & Integration Engineer
Datawatch Corporation
MA
(978) 935-3840
------------------------------
"

Clara

Clara said:

Thank you.  It will be several days before I try this out but I'll let you know how it goes!

 

------Original Message------

Clara,
To assign a wild card in the file name in the Automator Visual Process perform the following steps:
First upload the workspace in the server library.
Create a Visual Process, add a database input and use a wild card in the path.
Add a workspace object to the canvas,
Connect the database input to the workspace. 
In the workspace property pane, select the database input  in the File name list.
I assumed when you used the csv fine in DPS, you used the delimited text option.  If you used the text option in DPS, then in Visual Process you should use File Input object instead of Database Input object.
Regards
Mo

------------------------------
Mahmoud Abdolrahim
Senior Implementation & Integration Engineer
Datawatch Corporation
MA
(978) 935-3840
------------------------------
"

I was able to apply a wildcard from the Automator inside a Visual Process though I had to use a database source input rather than file input for csv and excel source files - so far this seems fine.  Thank you for your help Steve and Mahmoud,

------------------------------
Clara
Business Analyst
IL
------------------------------
-------------------------------------------
Original Message:
Sent: 02-26-2019 12:18 PM
From: Clara Bonaccorsi
Subject: Data Prep Studio input path wildcard

Thank you.  It will be several days before I try this out but I'll let you know how it goes!

 

Original Message------

Clara,
To assign a wild card in the file name in the Automator Visual Process perform the following steps:
First upload the workspace in the server library.
Create a Visual Process, add a database input and use a wild card in the path.
Add a workspace object to the canvas,
Connect the database input to the workspace.
In the workspace property pane, select the database input  in the File name list.
I assumed when you used the csv fine in DPS, you used the delimited text option.  If you used the text option in DPS, then in Visual Process you should use File Input object instead of Database Input object.
Regards
Mo

------------------------------
Mahmoud Abdolrahim
Senior Implementation & Integration Engineer
Datawatch Corporation
MA
(978) 935-3840
------------------------------
"