The Siemens Community Catalyst program was co-created with our community to acknowledge technology leaders who consistently contribute to the Siemens Community. Nominations are accepted on a rolling basis.
I come across a task is to read the data from a publication from the government. when I read it with rapid miner, it shows the wrong label and wrong cell content. the file is in CSV format. For example, if I read it in excel, the cell has 2 lines but rapid miner shows 2 cells instead.
https://files.ontario.ca/opendata/2536_bridge_conditions.csv
Hi @wdeng
It's a bit tricky to understand the issue without knowing how exactly you are expecting the data to look like.
I tried to read this file with RM and logically the structure looks ok, except that the heading row seems to be consisting of multiple (bi-lingual) entries (?). Maybe this is where you should go for manual columns renaming. Otherwise, comma delimited values in the columns seem valid to me.
UPD: opening file in Excel (Mac version) gives me that:
I am afraid the header of the csv is incorrect. I think that you should edit it to be only one line separated by single commas.
Hi @wdeng,
indeed it would be better to have a file with better (i.e. consistent) formatting.
In the actual case you could use the Read CSV Operator with the Wizard and play around with the settings. Screenshots with my settings are attached. They worked for me to get at least a portion of your data.
Best,
Edin
I expect the data look like this. Thank you for replying.
Once I edit the CSV file, the file will be corrupted.
I did this but rapide miner only shows half of the header. It cuts off at current header.
Unfortunately, I think fancy regular expressions also won't help you in this case.
You need to have all relevant attributes in one line. Your desired output reflects that you want a combination of the lines 4,5 and 6 as Attribute names. So you need to manually combine them using a file editor. While doing this I recommend to delete the lines 1-3.
Then you should be all set to read in your file with Separator "Comma" and "Use Quotes" checked.
Join us for a community conversation on how High-Performance Computing (HPC) and Simcenter PSIM work together to meet the increasing demands of modern power electronics simulation. During this one-hour technical session, you'll discover how leveraging HPC can speed up simulations, improve scalability, and empower engineers…
Join us for a community conversation on accelerating your motor simulation workflow with Simcenter Simlab. In this beginner-friendly session, we'll introduce the platform's automated model-building capabilities and show how easy it is to set up your first electric motor analysis. You'll see the basic steps of geometry…
Join us for a Community Conversation where we'll discuss practical approaches to analyzing complex electromagnetic models using hybrid solver techniques. This session will provide a general overview of how different computational methods can be combined within a single simulation to address models containing varied…
