🎉Community Raffle - Win $25

An exclusive raffle opportunity for active members like you! Complete your profile, answer questions and get your first accepted badge to enter the raffle.
Join and Win

"Total records in imported data aggregates with old imported data"

User: "jdude35"
New Altair Community Member
Updated by Jocelyn

Hello, I am relatively new to RapidMiner.  I am using the Rosette extension for text mining. I have imported a number of practice datasets to see how the various text mining algorithms work. The problem I am having is, whenever I import a new CSV file, no matter how I import it, the data somehow aggregates or combines with prior data.  For example, I had one dataset with 1035 records. Later, I imported a dataset with only 100 records in it and it shows up with 1135 records. Is there a step in the import process that is causing all of my data to accumulate in this unwanted fashion?

Find more posts tagged with

Sort by:
1 - 1 of 11
    User: "sgenzer"
    Altair Employee
    Accepted Answer

    hello @jdude35 - welcome to the RapidMiner User Community.  We are happy to have you here.

     

    That is indeed odd.  The number of rows that you import by CSV should indeed be the number of rows.  Tell you what - instead of using the "Add Data" button, try using the "Read CSV" operator as the beginning of your process.  It's a better way to go anyway.

     

    Screen Shot 2017-10-02 at 9.50.46 PM.png

    Use the "Import Configuration Wizard" to set up the Read CSV operator, or just press go and see what happens.  Note that the default column separator for "Read CSV" is a semi-colon (;), not a comma (,) as one may expect from a CSV file.

     

    If you still have trouble, I recommend copying your process XML (open the XML tab) and pasting it here in this thread using the </> button.  This helps all of us troubleshoot each other.


    Scott