Joining two sub-processes together, first classification and then clustering

amir_askary_sha

Hi there,

 

I have two sub-processes and I want to join them together in order to have a complete automated process.

 

The first process is a CLASSIFICATION task, which gets some text documents and then by Applying a previousely trained model puts the documents into 5 classes: politic, sport, science, ... . The output is a table with document IDs and the classes as label.

 

the second process is a CLUSTERING task, which gets some text documents and then using k-means algorithm, puts the documents in different clusters.

 

I want to join these two processes together, meaning first applying the classification and then applying the clustering 5 times for each group.

 

I don't know how to achieve this but I feel I should use the loop operator and somehow a split table operator to break the table result of first sub-process and loop over sub-tables.

 

Any help is appreciated. thanks

sgenzer

hmmm...perhaps this is something you can work from?  My "amir1" is your first process and my "amir2" is your second process.  I was not sure if your label was actually called "classes" but you can change it in the parameters for "Loop Values".

 

<?xml version="1.0" encoding="UTF-8"?><process version="7.6.001">
  <context>
    <input/>
    <output/>
    <macros/>
  </context>
  <operator activated="true" class="process" compatibility="7.6.001" expanded="true" name="Process">
    <process expanded="true">
      <operator activated="true" class="productivity:execute_process" compatibility="7.6.001" expanded="true" height="82" name="Execute amir1" width="90" x="45" y="34">
        <parameter key="process_location" value="//RapidMiner OneDrive/random community stuff/amir1"/>
        <list key="macros"/>
      </operator>
      <operator activated="true" class="concurrency:loop_values" compatibility="7.6.001" expanded="true" height="82" name="Loop Values" width="90" x="179" y="34">
        <parameter key="attribute" value="classes"/>
        <process expanded="true">
          <operator activated="true" class="filter_examples" compatibility="7.6.001" expanded="true" height="103" name="Filter Examples" width="90" x="45" y="34">
            <list key="filters_list">
              <parameter key="filters_entry_key" value="classes.equals.%{loop_value}"/>
            </list>
          </operator>
          <operator activated="true" class="productivity:execute_process" compatibility="7.6.001" expanded="true" height="68" name="Execute amir2" width="90" x="179" y="34">
            <parameter key="process_location" value="//RapidMiner OneDrive/random community stuff/amir2"/>
            <list key="macros"/>
          </operator>
          <connect from_port="input 1" to_op="Filter Examples" to_port="example set input"/>
          <connect from_op="Filter Examples" from_port="example set output" to_op="Execute amir2" to_port="input 1"/>
          <connect from_op="Execute amir2" from_port="result 1" to_port="output 1"/>
          <portSpacing port="source_input 1" spacing="0"/>
          <portSpacing port="source_input 2" spacing="0"/>
          <portSpacing port="sink_output 1" spacing="0"/>
          <portSpacing port="sink_output 2" spacing="0"/>
        </process>
      </operator>
      <connect from_op="Execute amir1" from_port="result 1" to_op="Loop Values" to_port="input 1"/>
      <connect from_op="Loop Values" from_port="output 1" to_port="result 1"/>
      <portSpacing port="source_input 1" spacing="0"/>
      <portSpacing port="sink_result 1" spacing="0"/>
      <portSpacing port="sink_result 2" spacing="0"/>
    </process>
  </operator>
</process>

Scott