Rapidminer with Spark

d_walden18863
d_walden18863 New Altair Community Member
edited November 5 in Community Q&A

I realize RapidMiner can be implemented with Spark in the Hadoop environment on a cluster but my question is can RadipMiner be implemented with Spark on a Standalone? If so, can you direct me to some information to help me with the implementation?

Tagged:

Answers

  • zprekopcsak
    zprekopcsak New Altair Community Member

    Hi,

     

    RapidMiner Radoop always requires Hadoop (or more specifically Hive, HDFS and YARN) underneath so it cannot work with pure Spark.

     

    Best, Zoltan

  • Thomas_Ott
    Thomas_Ott New Altair Community Member

    I don't if that's been done yet but it might be feasible.

     

    You could, in theory write your spark code and then have it kick off in RapidMiner using an Execute Program operator. You could pass commands, environment variables, and even some sort of throughput file into the operator that could in theory feed your pure spark program. 

     

Categories