what's the limit of amont of data that RapidMiner can handle?

Question

Hi,

The number of my examples is 10530 and the number of the attributes is about 334. I am running RapidMiner on my desktop. However, it kept freezing. So,  I would like to know whether this is due to the limit of my desktop's memory or it is beyond RapidMiner's ability to handle this amount of data.

Also,  if RapidMiner crashes, is there any way I could retrieve the part of results that RapidMiner has processed?

Thanks a lot!

Xia

abehera1992 · Answer

Is your operators producing output from selected nodes given the huge data processing invoved instead of having issues in single table?

xiazhang3 · Answer

Thanks a lot for your inputs!

I am throwing my data though SVM. It crashed after several hours without writing anything to the log file. I will try to avoid the large table output.

xixirhwfy · Answer

I solved my problem just now. The reason is not the limitation of memory, but the table size in the result is too big(my result is 6500*6500 tupples with 50 attributes ). I cancelled the operator used to show the large table, and only display other results, then the results come out successfully. So maybe you also tried to display result in very large tables. Try to disable the large table.