How to execute python operator in radoop nest?

Harshav
New Altair Community Member
1.I tried executing with sparkrm ,but it failed .
2.When I tried executing the python operator in radoop nest without using sparkrm (execute python) ,I got output with null values with exact columns that are required.
3.When I use write to csv and connect that ports to execute python , I'm getting perfect results
But without using write to csv ,How can i execute this execute python operator and get the results?
2.When I tried executing the python operator in radoop nest without using sparkrm (execute python) ,I got output with null values with exact columns that are required.
3.When I use write to csv and connect that ports to execute python , I'm getting perfect results
But without using write to csv ,How can i execute this execute python operator and get the results?
Tagged:
0
Answers
-
Hi,I strongly advice against doing it. Keep in mind what happens if you run a python script in a SparkRM. There are several JVMs started on different computers of your Spark-Cluster. All of those need the correct environments etc.Are there really no ways of doing this with Radoop operators?Best,Martin0
-
As I have explained you martin , I used write to csv (radoop operator ) before the execute python operator so that I could get the results( I got results by that method ),but since process is designed in such a way that there are no intermediate tables .Is there any method to convert hive table in radoop nest to be more flexible for python execute operator ,so that it can read and give the desired results.0
-
Hi @Harshav ,if this is an emergency, than please use support.rapidminer.com. On support.rapidminer.com we have support level agreements to answer emergencies swiftly.On the topic itself, I do not understand the problem, so I cannot really comment on it. Also again, i highly advice against using it at all.Best,Martin0