"Row Limit Question"

JonByford
JonByford New Altair Community Member
edited November 2024 in Community Q&A

I'm using the free edition of RapidMiner Studio, which limits me to 10,000 rows of data.

 

Does anyone know how the limit is implemented with respect to loops?

 

I have a process that uses 4300 rows of data, but when entering a loop I hit the 10,000 row limit.

 

Thanks,

Jon

Best Answer

  • JonByford
    JonByford New Altair Community Member
    Answer ✓

    Yes, I have a process documents step that creates n-grams without any pruning. I'm pretty confident this is the problem, I'd assumed that it was the process that had the row limit rather than every operator within it.

     

    Adding some pruning to the process docs step has solved the issue, without a material impact on the outcome.

     

    Thanks,

     

    Jon

Answers

  • Thomas_Ott
    Thomas_Ott New Altair Community Member

    Does the subprocess in the Loop add rows as a result of what you're Looping?

  • JonByford
    JonByford New Altair Community Member
    Answer ✓

    Yes, I have a process documents step that creates n-grams without any pruning. I'm pretty confident this is the problem, I'd assumed that it was the process that had the row limit rather than every operator within it.

     

    Adding some pruning to the process docs step has solved the issue, without a material impact on the outcome.

     

    Thanks,

     

    Jon