RM Server: Job agent extensions are not loaded correctly

mschwarzer
mschwarzer New Altair Community Member
edited November 5 in Community Q&A

I'm runing Rapidminer server (from Amazon AMI) but my bundled job agent does not recognize the extensions correctly. Loading the Web mining extensions fails due to missing dependency of Text mining extension even if the rmx_text.jar is in the extensions directory.

 

Error log from job execution:

 

...
2018-03-04 14:32:30.213  INFO 3724 --- [main] c.r.e.j.s.RapidMinerInitializerService   : Setting execution mode to 'APPSERVER'
2018-03-04 14:32:30.213  INFO 3724 --- [main] c.r.e.j.s.RapidMinerInitializerService   : Loading extensions from '/opt/rmserver/job-agent/extensions'
2018-03-04 14:32:30.223  INFO 3724 --- [main] com.rapidminer                           : Performing upgrade  to version 8.1.000
2018-03-04 14:32:30.224  INFO 3724 --- [main] com.rapidminer                           : Set locale to en.
2018-03-04 14:32:30.260  INFO 3724 --- [main] PlatformUtilities                        : rapidminer.home is '/opt/rmserver/job-agent/engine'.
2018-03-04 14:32:30.275  INFO 3724 --- [main] com.rapidminer                           : Initializing license manager.
2018-03-04 14:32:30.534  INFO 3724 --- [main] com.rapidminer                           : Cannot access file system in execution mode APPSERVER. Not loading repositories.
2018-03-04 14:32:30.993  INFO 3724 --- [main] com.rapidminer                           : Register plugin: PMML
2018-03-04 14:32:30.993  INFO 3724 --- [main] com.rapidminer                           : Register plugin: JDBC Connectors
2018-03-04 14:32:30.993  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Remote Repository
2018-03-04 14:32:30.993  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Advanced File Connectors
2018-03-04 14:32:30.993  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Professional
2018-03-04 14:32:30.993  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Productivity
2018-03-04 14:32:30.993  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Legacy Result Access
2018-03-04 14:32:30.993  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Process Scheduling
2018-03-04 14:32:30.994  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Social Media
2018-03-04 14:32:30.994  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Cloud Connectivity
2018-03-04 14:32:30.994  INFO 3724 --- [main] com.rapidminer                           : Register plugin: H2O
2018-03-04 14:32:30.994  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Concurrency
2018-03-04 14:32:30.994  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Model Simulator
2018-03-04 14:32:30.994  INFO 3724 --- [main] com.rapidminer                           : Register plugin: MeaningCloud
2018-03-04 14:32:30.994  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Pdf Table Extraction
2018-03-04 14:32:30.994  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Web Mining
2018-03-04 14:32:30.994  INFO 3724 --- [main] com.rapidminer                           : Register plugin: Weka
2018-03-04 14:32:31.011 ERROR 3724 --- [main] com.rapidminer                           : Cannot load extension rmx_web: Depends on rmx_text which cannot be found!
2018-03-04 14:32:31.799  INFO 3724 --- [main] com.rapidminer                           : Registered configurator Twitter Connection.
2018-03-04 14:32:32.139  INFO 3724 --- [main] com.rapidminer                           : Registered configurator Salesforce Connection.
2018-03-04 14:32:32.140  INFO 3724 --- [main] com.rapidminer                           : Registered configurator Amazon S3 Connection.
...

My extensions folders looks the following:

[root@ip-172-31-14-238 job-agent]# ls /opt/rmserver/job-agent/extensions/custom/extensions/ -l
total 100204
-rw-r--r--. 1 root root  6537031  4. Mär 13:59 rmx_com.aylien.textapi.rapidminer-ANY-0.2.0.jar
-rw-r--r--. 1 root root   300178  4. Mär 13:59 rmx_keras-ANY-1.0.3.jar
-rw-r--r--. 1 root root    99973  4. Mär 13:59 rmx_MeaningCloud-ANY-1.0.1.jar
-rw-r--r--. 1 root root  4869914  4. Mär 13:59 rmx_operator_toolbox-ANY-0.9.0.jar
-rw-r--r--. 1 root root 22575659  4. Mär 13:59 rmx_paren-ANY-5.3.1.jar
-rw-r--r--. 1 root root 13643313  4. Mär 13:59 rmx_pdf_table_extraction-ANY-0.2.1.jar
-rw-r--r--. 1 root root    81533  4. Mär 13:59 rmx_python_scripting-ANY-7.4.0.jar
-rw-r--r--. 1 root root  2291491  4. Mär 13:59 rmx_reporting-ANY-5.3.0.jar
-rw-r--r--. 1 root root   470464  4. Mär 13:59 rmx_series-ANY-7.4.0.jar
-rw-r--r--. 1 root root 21378013  4. Mär 13:59 rmx_text-ANY-8.1.0.jar
-rw-r--r--. 1 root root 23160834  4. Mär 13:59 rmx_web-ANY-7.3.0.jar
-rw-r--r--. 1 root root  7183194  4. Mär 13:59 rmx_weka-ANY-7.3.0.jar

As a result my process fails because a operator is missing:

...
2018-03-04 14:32:43.603  INFO 3724 --- [main] c.r.e.j.e.ExecutionProcessListener       : Execution of process stopped
2018-03-04 14:32:43.610 ERROR 3724 --- [main] c.r.e.j.service.ErrorReporterService     : User Error during execution

com.rapidminer.operator.UserError: The dummy operator Process Documents from Web (replacing web:process_web_modern) cannot be executed. 
	at com.rapidminer.operator.DummyOperator.doWork(DummyOperator.java:94)
...

Any help? Does it depend on the order in which the extensions are loaded?

 

Best regards

Tagged:

Best Answer

Answers

  • Pavithra_Rao
    Pavithra_Rao New Altair Community Member

    @mschwarzer

    Could you confirm if you have placed the extension jar files in both server root directory and extension directory?

     

    i.e C:\RapidMinerServer8.1\extensions and C:\RapidMinerServer8.1\job-agent\extensions.

     

    The new server architecture is made such that, we need to place the extensions in server root directory and desired job-agent extension directory.

     

    Hope this helps.

     

    Cheers

     

  • mschwarzer
    mschwarzer New Altair Community Member

    Yes - extensions are also available for rmserver/standalone

     

    [root@ip-172-31-14-238 centos]# ls -l /opt/rmserver/extensions/custom/
    total 100204
    -rw-r--r--. 1 root root  6537031  4. Mär 15:23 rmx_com.aylien.textapi.rapidminer-ANY-0.2.0.jar
    -rw-r--r--. 1 root root   300178  4. Mär 15:23 rmx_keras-ANY-1.0.3.jar
    -rw-r--r--. 1 root root    99973  4. Mär 15:23 rmx_MeaningCloud-ANY-1.0.1.jar
    -rw-r--r--. 1 root root  4869914  4. Mär 15:23 rmx_operator_toolbox-ANY-0.9.0.jar
    -rw-r--r--. 1 root root 22575659  4. Mär 15:23 rmx_paren-ANY-5.3.1.jar
    -rw-r--r--. 1 root root 13643313  4. Mär 15:23 rmx_pdf_table_extraction-ANY-0.2.1.jar
    -rw-r--r--. 1 root root    81533  4. Mär 15:23 rmx_python_scripting-ANY-7.4.0.jar
    -rw-r--r--. 1 root root  2291491  4. Mär 15:23 rmx_reporting-ANY-5.3.0.jar
    -rw-r--r--. 1 root root   470464  4. Mär 15:23 rmx_series-ANY-7.4.0.jar
    -rw-r--r--. 1 root root 21378013  4. Mär 15:23 rmx_text-ANY-8.1.0.jar
    -rw-r--r--. 1 root root 23160834  4. Mär 15:23 rmx_web-ANY-7.3.0.jar
    -rw-r--r--. 1 root root  7183194  4. Mär 15:23 rmx_weka-ANY-7.3.0.jar

    In the plugin directory, too (com.rapidanalytics.plugindir=/opt/rmserver/plugins):

    [root@ip-172-31-14-238 centos]# ls -l /opt/rmserver/plugins/custom/extensions/
    total 100204
    -rw-r--r--. 1 root root  6537031  4. Mär 13:59 rmx_com.aylien.textapi.rapidminer-ANY-0.2.0.jar
    -rw-r--r--. 1 root root   300178  4. Mär 13:59 rmx_keras-ANY-1.0.3.jar
    -rw-r--r--. 1 root root    99973  4. Mär 13:59 rmx_MeaningCloud-ANY-1.0.1.jar
    -rw-r--r--. 1 root root  4869914  4. Mär 13:59 rmx_operator_toolbox-ANY-0.9.0.jar
    -rw-r--r--. 1 root root 22575659  4. Mär 13:59 rmx_paren-ANY-5.3.1.jar
    -rw-r--r--. 1 root root 13643313  4. Mär 13:59 rmx_pdf_table_extraction-ANY-0.2.1.jar
    -rw-r--r--. 1 root root    81533  4. Mär 13:59 rmx_python_scripting-ANY-7.4.0.jar
    -rw-r--r--. 1 root root  2291491  4. Mär 13:59 rmx_reporting-ANY-5.3.0.jar
    -rw-r--r--. 1 root root   470464  4. Mär 13:59 rmx_series-ANY-7.4.0.jar
    -rw-r--r--. 1 root root 21378013  4. Mär 13:59 rmx_text-ANY-8.1.0.jar
    -rw-r--r--. 1 root root 23160834  4. Mär 13:59 rmx_web-ANY-7.3.0.jar
    -rw-r--r--. 1 root root  7183194  4. Mär 13:59 rmx_weka-ANY-7.3.0.jar

     

     

  • mschwarzer
    mschwarzer New Altair Community Member

    Web mining + text processing extensions show both up in the available operators page in the admin interface:

     




    Text Processing

    (rmx_text)


    		 7.5.0



    Value Series

    (rmx_series)


    		 7.4.0



    Web Mining

    (rmx_web)

    7.3.0

    Maybe it's version related? The file name is "rmx_text-ANY-8.1.0.jar" but in the web interface it's 7.5.0.
  • mschwarzer
    mschwarzer New Altair Community Member
    Answer ✓

    OK. The problem was the version. I replaced the latest version of rmx_text.jar with v7.5.0 which I downloaded from the marketplace by replacing the version numbers in the url:

     

    https://marketplace.rapidminer.com/UpdateServer/download-web/public/rmx_text/7.5.0/ANY

     

    For such situations I'd be good to download older versions from the marketplace directly.

Categories