How to store .CSV data files for re-usability

T4lha

Hi,

We are standing up a new RapidMiner 9.4 platform. The business wants the initial data-set (.CSV files) to be stored in the RapidMiner server. These files will be accessed by other RapidMiner users from Studio client tool.

My question is, what is the best way to do this for re-usability and thinking long-term? Does Studio have an option to achieve this? Can I set permissions on who should have access to this data from Studio? Or do I need to do this from the unix host?  

Thank you in advance!

TA

sgenzer

hi @T4lha - so good question. Do you want to store the actual .csv files or the converted ExampleSets on the RM Server? You can do it either way but it depends on how to want to work. I'd prefer the ExampleSet method as it's native to RapidMiner.

sgenzer

but basically yes - you can do full permission control from RapidMiner Server. I'd set up a folder in the RM Server for raw data and just keep everything there.

kayman

You can store your data in csv format in so called blob format. So they are not physically stored as csv format yet accessible as a csv from your repo so you can drag and drop them.

And if you set the access rights on the blob you have full control about it. But as mentioned by Scott you could achieve the same with an example set. 

sgenzer

hi @T4lha - so good question. Do you want to store the actual .csv files or the converted ExampleSets on the RM Server? You can do it either way but it depends on how to want to work. I'd prefer the ExampleSet method as it's native to RapidMiner.

sgenzer

but basically yes - you can do full permission control from RapidMiner Server. I'd set up a folder in the RM Server for raw data and just keep everything there.

kayman

You can store your data in csv format in so called blob format. So they are not physically stored as csv format yet accessible as a csv from your repo so you can drag and drop them.

And if you set the access rights on the blob you have full control about it. But as mentioned by Scott you could achieve the same with an example set.