Distribute process on a cluster of machines using RM Studio and Radoop extension

Zlatan95

Dear community,
I have an academic ML project and i need to distribute the process on a cluster of machines
Thus, I'm asking if you can provide me with resources or tutorials on how to distribute some process on a cluster using the RM Studio with the Radoop extension ?

Thanx

MarlaBot

Hi @Zlatan95 - this is MarlaBot. I found these great videos on our RapidMiner Academy that you may find helpful:

Instructional Video: The RapidMiner MarketPlace - Extensions (Viewing time: ~5m)

Instructional Video: Introducing RapidMiner Radoop (Viewing time: ~9m)

Instructional Video: hints: Extensions (Viewing time: ~2m)

Instructional Video: Document Similarity and Clustering (Viewing time: ~10m)

5 Min with Ingo Video: Agglomerative Clustering (Viewing Time: ~6m)

Please LIKE my comment if it helps! 👇

MarlaBot

sgenzer

hi @Zlatan95 sorry no one has chimed in here. Is this still an issue?

Scott

SGolbert

Hi @Zlatan95

I've been working a couple of years ago on tutorials for the Radoop extension, maybe @Knut-RM or @jmergler can tell you more about the current state of the project.

This is kind of obvious, but you need a Hadoop Cluster to be able to use the Radoop extension. Azure and AWS provide the easiest solutions. If you want to use your own computers for that, that is quite a challenge.

Can you explain the problem in detail, so that we can find the optimal solution for you?

Regards,

Sebastian

Nikouy

Hi Folks,

I'd be interested in knowing if there is  solution to this or if it's possible to create a cluster of machines to mine data.

Thanks

Zlatan95

Yes Nikouy this is possible.
You can set up Rapidminer Radoop with the Hortonworks Data Platform (HDP) so that you will be able to distribute your RM processes on a cluster of machines within your HDP image.