Row/Attribute performance after importing (Missing rows and attributes)

utvanhuynh1989

Hello,

I have some text files to import to Rapid Miner. For samples:

1. I have a raw text file
- Total record: 1408866
- Column/Attribute: 71
* After importing the file into RapidMiner
- Total record: 148773 (missing 93 records)

- Column/Attribute: 71

2. I have another text file
- Total record: 287147
- Column/Attribute: 269
* After importing the file into RapidMiner
- Total record: 287109 (missing 38 records)
- Column/Attribute: 35

Then I was trying to re-import the file and uncheck "Skip comments". The first file remained the same, the second file showed the exact record but only 265 attributes.

Is there any problem with the importing feature? How can I get full rows/attributes always from the file?

Thank you.

Find more posts tagged with

AI Studio

Performance

Getting Started

Accepted answers

Thomas_Ott

You will have to use the Read CSV operator and go more to the manual import. Use the Import Wizard button on the Read CSV operator it self and then select ALL FILES in the dropdown box for the File Selector to select the TXT file. It should load just fine then and you can use the wizard to format it.

All comments

bhupendra_patil

What kind of file is this CSV?

Are you using the read csv operator or the import wizard

If using the read csv operator, on the last screen it has a checkbox to select first 100 rows for preview, uncheck that and see if you see errors or warnings at the bottom of the screen

utvanhuynh1989

Thank you for the reply.

This is not csv file. It is txt file. I am using both "Add data" wizard from "repository" and the "read csv" from "operators". Both give out the same result.

The txt file remained missing rows and attributes.

Can you please help me out?

Thomas_Ott

utvanhuynh1989

Thank you, Thomas. It is working just fine now.