[SOLVED] Hardware Recommendations for Running RapidMiner

Question

Folks,

I will be starting a text mining project and hope to use RapidMiner.  The data could get fairly big.

*****Does anyone have hardware recommendations for running RapidMiner? I may be able to run on a reasonably good UNIX server.

****Is there more value in using extra memory for example? Or processor? Or Storage?

I will be using the Community Edition at this point, so I presume that processing will be done in-memory rather than in database in which case fast storage wouldn't offer any benefits.  So my guess is memory and processor are the things to look at.  But there may be a scale beyond which benefits would not be increasing aswell.

(I posted about this last week but didn't get responses. I've tried to rephrase my query in a clearer way.)

Regards,
John.

jcurry1 · Answer

That's great.  Thanks for all the help.
John.

MariusHelf · Answer

jcurry1  wrote:As I understand it, RapidMiner does all of its processing  in-memory so the database setup wouldn't affect performance i.e. the data will input into memory through one of the read-in nodes and for all of the procesing from then on, the database is out of the equation.  Is it fairly accurate to say this?

Yes, that's correct.

jcurry1 · Answer

Thanks for that Marius.  Just as regards databases, I will be accessing data from an Ingres SQL Database or Vectorwise Database that may be held on the same server or else will connect through Vnodes to other servers.

As I understand it, RapidMiner does all of its processing  in-memory so the database setup wouldn't affect performance i.e. the data will input into memory through one of the read-in nodes and for all of the procesing from then on, the database is out of the equation.  Is it fairly accurate to say this?