"Simple java program"
Find more posts tagged with
Sort by:
1 - 18 of
181
Hi Marco,
thanks for picking this up.
I tried different execution modes without any effect (didn't notice differences between UI, COMMAND_LINE or the EMBEDDED ones for my simple test program). Before updating to revision 313 everything worked fine (as reported in the linked topic), and when switching back to 312 it still does. I took a short look at the code changes but am not familiar enough with the classes to identify the critical change. It would be great if you could figure this out someday
In order to get the plugin operators working I had to point to a directory where I placed a copy of the jar libraries. I don't know if it's possible to use the libs contained in the RM lib folder, but I didn't manage to use them by default. So I played around with the initialization properties I found in the wiki until it worked:
Best regards
Matthias
thanks for picking this up.
I tried different execution modes without any effect (didn't notice differences between UI, COMMAND_LINE or the EMBEDDED ones for my simple test program). Before updating to revision 313 everything worked fine (as reported in the linked topic), and when switching back to 312 it still does. I took a short look at the code changes but am not familiar enough with the classes to identify the critical change. It would be great if you could figure this out someday
In order to get the plugin operators working I had to point to a directory where I placed a copy of the jar libraries. I don't know if it's possible to use the libs contained in the RM lib folder, but I didn't manage to use them by default. So I played around with the initialization properties I found in the wiki until it worked:
//System.setProperty("rapidminer.init.operators", "false"); //(file path)
System.setProperty("rapidminer.init.plugins", "true"); //(true or false)
System.setProperty("rapidminer.init.plugins.location", "C:\\Matthias\\Workspace\\Eclipse\\GUITest\\lib"); //(directory path)
System.setProperty("rapidminer.init.weka", "false"); //(true or false)
System.setProperty("rapidminer.init.jdbc.lib", "false"); //(true or false)
//System.setProperty("rapidminer.init.jdbc.lib.location", "false"); //(directory path)
System.setProperty("rapidminer.init.jdbc.classpath", "false"); //(true or false)
But don't ask me if this all makes sense Best regards
Matthias
Hi Marco,
thanks for this update. I am currently moving away from generating operators from Java code and using predefined general processes instead. As you are recently posting in some other topics, creating a whole process via the API is not that comfortable at all.
Since I don't need dynamically built processes but just have to cover some fixed application patterns, I am fine with predefined XML declarations. Otherwise, I will play Phil's "Going Back" album while switching back to the old revision for now.
The only thing I did not test until now is how to connect two or more of those process patterns. I have to connect data collection with data analysis for example. For both tasks exist pools of 3-5 possible process patterns (processes completly designed with the GUI). After connecting them the only task remaining will be setting specific parameters for the relevant operators from Java, which should not cause so much troubles. If you have some hints on how to possibly connect multiple process files into one, I would be glad. If this is not possible with reasonable efforts, I will probably need to keep them as mutliple processes and define a data flow between them.
Best regards
Matthias
thanks for this update. I am currently moving away from generating operators from Java code and using predefined general processes instead. As you are recently posting in some other topics, creating a whole process via the API is not that comfortable at all.
Since I don't need dynamically built processes but just have to cover some fixed application patterns, I am fine with predefined XML declarations. Otherwise, I will play Phil's "Going Back" album while switching back to the old revision for now.
The only thing I did not test until now is how to connect two or more of those process patterns. I have to connect data collection with data analysis for example. For both tasks exist pools of 3-5 possible process patterns (processes completly designed with the GUI). After connecting them the only task remaining will be setting specific parameters for the relevant operators from Java, which should not cause so much troubles. If you have some hints on how to possibly connect multiple process files into one, I would be glad. If this is not possible with reasonable efforts, I will probably need to keep them as mutliple processes and define a data flow between them.
Best regards
Matthias
Hi Marco,
it seems I won't get the process working again
I changed the ExecutionMode and tried possible variations of the system properties. Without any success. I removed all of the other operators except "Get Page" and still receive the same error message.
This is the entire code I am using:
Thank you for the simple solution of combining multiple process files by a new process using "Execute Process". This easiest way did not come to my mind... But there seems to be a major limitation for this solution. I will certainly not be able to set parameters for the operators from the embedded processes. But this is an important step before executing the comined process. Do you have any suggestions on this?
Best regards
Matthias
Edit: After thinking the whole thing over again, I assume it might become a bit untidy, but it would be a simple approach to use the suggested master process combining all process parts by using "Execute Process" operatores and set the parameters via macros. After setting the relevant parameters with some predefined macro names I will just have to deliver them with their values to the several process executions. Thanks again for providing this simple solution.
it seems I won't get the process working again
I changed the ExecutionMode and tried possible variations of the system properties. Without any success. I removed all of the other operators except "Get Page" and still receive the same error message.This is the entire code I am using:
import com.rapidminer.Process;I don't know if something else is wrong, but it was working in the older revision without any problems...
import com.rapidminer.RapidMiner;
import com.rapidminer.RapidMiner.ExecutionMode;
import com.rapidminer.operator.ExecutionUnit;
import com.rapidminer.operator.IOContainer;
import com.rapidminer.operator.Operator;
import com.rapidminer.operator.OperatorException;
import com.rapidminer.operator.io.web.GetWebpageOperator;
import com.rapidminer.tools.OperatorService;
public class ExecuteProcessTest {
/**
* Connect the output-port <code>fromPortName</code> from Operator
* <code>from</code> with the input-port <code>toPortName</code> of Operator
* <code>to</code>.
*/
private static void connect(Operator from, String fromPortName, Operator to, String toPortName) {
from.getOutputPorts().getPortByName(fromPortName).connectTo(to.getInputPorts().getPortByName(toPortName));
}
/**
* Connect the output-port <code>fromPortName</code> from Subprocess
* <code>from</code> with the input-port <code>toPortName</code> of Operator
* <code>to</code>.
*/
private static void connect(ExecutionUnit from, String fromPortName, Operator to, String toPortName) {
from.getInnerSources().getPortByName(fromPortName).connectTo(to.getInputPorts().getPortByName(toPortName));
}
/**
* Connect the output-port <code>fromPortName</code> from Operator
* <code>from</code> with the input-port <code>toPortName</code> of
* Subprocess <code>to</code>.
*/
private static void connect(Operator from, String fromPortName, ExecutionUnit to, String toPortName) {
from.getOutputPorts().getPortByName(fromPortName).connectTo(to.getInnerSinks().getPortByName(toPortName));
}
/**
* Connect the output-port <code>fromPortName</code> from Subprocess
* <code>from</code> with the input-port <code>toPortName</code> of
* Subprocess <code>to</code>.
*/
private static void connect(ExecutionUnit from, String fromPortName, ExecutionUnit to, String toPortName) {
from.getInnerSources().getPortByName(fromPortName).connectTo(to.getInnerSinks().getPortByName(toPortName));
}
private static Process createProcess(String url, String regex) {
//System.setProperty("rapidminer.init.operators", "false"); //(file path)
System.setProperty("rapidminer.init.plugins", "true"); //(true or false)
System.setProperty("rapidminer.init.plugins.location", "C:\\Matthias\\Workspace\\Eclipse\\GUITest\\lib"); //(directory path)
System.setProperty("rapidminer.init.weka", "false"); //(true or false)
System.setProperty("rapidminer.init.jdbc.lib", "false"); //(true or false)
//System.setProperty("rapidminer.init.jdbc.lib.location", "false"); //(directory path)
System.setProperty("rapidminer.init.jdbc.classpath", "false"); //(true or false)
// invoke init before using the OperatorService
RapidMiner.setExecutionMode(ExecutionMode.COMMAND_LINE);
RapidMiner.init();
// create process
Process process = new Process();
try {
// create operator
Operator retrieveOperator = OperatorService.createOperator(GetWebpageOperator.class);
// set parameters
retrieveOperator.setParameter("url", url);
retrieveOperator.setParameter("random_user_agent", "true");
// add operator to process
process.getRootOperator().getSubprocess(0).addOperator(retrieveOperator);
// connect operators
connect(retrieveOperator, "output", process.getRootOperator().getSubprocess(0), "result 1");
} catch (Exception e) { e.printStackTrace(); }
return process;
}
public static IOContainer run(String url, String regex) {
// create process
Process process = createProcess(url, regex);
IOContainer processResult = null;
try {
// perform process
processResult = process.run();
} catch (OperatorException e) { e.printStackTrace(); }
return processResult;
}
public static void main(String[] argv) {
// create process
Process process = createProcess("http://www.google.com", "<a href=\\\".*?\\\"[^>]*>(.*?)</a>");
// print process setup
System.out.println(process.getRootOperator().createProcessTree(0));
try {
// perform process
IOContainer ioResult = process.run();
// to run the process with input created by your application use
// process.run(new IOContainer(new IOObject[] { ... your objects ... });
} catch (OperatorException e) { e.printStackTrace(); }
}
}
Thank you for the simple solution of combining multiple process files by a new process using "Execute Process". This easiest way did not come to my mind... But there seems to be a major limitation for this solution. I will certainly not be able to set parameters for the operators from the embedded processes. But this is an important step before executing the comined process. Do you have any suggestions on this?
Best regards
Matthias
Edit: After thinking the whole thing over again, I assume it might become a bit untidy, but it would be a simple approach to use the suggested master process combining all process parts by using "Execute Process" operatores and set the parameters via macros. After setting the relevant parameters with some predefined macro names I will just have to deliver them with their values to the several process executions. Thanks again for providing this simple solution.
I experienced a similar problem some weeks ago. My own program was working fine until some update to the RapidMiner core was released. I posted this information here: http://rapid-i.com/rapidforum/index.php/topic,294.msg13414.html#msg13414
But until now the problem was not fixed, I just noticed this when testing my program again after reading your post. I would also appreciate any other solution than switching back to the old revision.
Best regards
Matthias