Run RapidMiner across cluster ??

Rhmanig
Rhmanig New Altair Community Member
edited November 2024 in Community Q&A
Hi everyone,

I have Rapidminer installed on a node of a cluster and need to distribute the process across nodes. Does RapidMiner support this? Is there anyway to do this on RapidMiner?

I know it has multi threading feature but that is not what I am after, at least not yet.

Or
if I need to write script to distribute jobs across nodes, can someone please help me to write one.

Thanks
Tagged:

Answers

  • Marco_Boeck
    Marco_Boeck New Altair Community Member
    Hi,

    a single process cannot be distributed unless you are using RapidMiner Radoop or RapidMiner Streams which utilize frameworks designed for working in a clustered environment.

    If you want to distribute multiple long running processes to different machines you'd have to do it manually by scheduling them on different RapidMiner Server instances. A Server will only execute process on its own machine so multiple servers are a necessity then.

    Regards,
    Marco