Aggregate function still being a PIECE OF CRAP!! 1 year later, I HATE THIS!

781194025
781194025 New Altair Community Member
edited November 5 in Community Q&A

Everything works fine. Even aggregate. 

 

BUT, it screws up their ID!! Even though its 'group by id'. WHY?!?!?

 

It should have the social media platforms attached to the proper 'name' , but instead they aggregate fine, concatenate fine, and then end up under some random name!!

 

Even though it should be 'grouping by ID'.

 

I attached 2 CSV files so you can use them to test the process!! PLEASE HELP!!!

 

<?xml version="1.0" encoding="UTF-8"?><process version="8.2.001">
<context>
<input/>
<output/>
<macros/>
</context>
<operator activated="true" class="process" compatibility="8.2.001" expanded="true" name="Process">
<process expanded="true">
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV" width="90" x="112" y="136">
<parameter key="csv_file" value="Z:\items_icodrops.com_4.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role" width="90" x="313" y="136">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (2)" width="90" x="112" y="238">
<parameter key="csv_file" value="Z:\items_icodrops.com_5.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (2)" width="90" x="313" y="238">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (3)" width="90" x="112" y="340">
<parameter key="csv_file" value="Z:\items_icodrops.com_7.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (3)" width="90" x="313" y="340">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (4)" width="90" x="112" y="442">
<parameter key="csv_file" value="Z:\items_icodrops.com_8.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (4)" width="90" x="313" y="442">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (5)" width="90" x="112" y="544">
<parameter key="csv_file" value="Z:\items_icodrops.com_9.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (5)" width="90" x="313" y="544">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (6)" width="90" x="112" y="646">
<parameter key="csv_file" value="Z:\items_icodrops.com_10.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (6)" width="90" x="313" y="646">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="187" name="Append" width="90" x="514" y="289"/>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes" width="90" x="648" y="289">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attributes" value="_cached_page_id|_template|_type"/>
<parameter key="invert_selection" value="true"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates" width="90" x="782" y="289">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="name"/>
<parameter key="include_special_attributes" value="true"/>
</operator>
<operator activated="false" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Loop Collection" width="90" x="2122" y="1207">
<parameter key="unfold" value="true"/>
<process expanded="true">
<connect from_port="single" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="loop_collection" compatibility="8.2.001" expanded="true" height="68" name="Loop Collection (2)" width="90" x="2055" y="1054">
<parameter key="set_iteration_macro" value="true"/>
<parameter key="unfold" value="true"/>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember" width="90" x="179" y="34">
<parameter key="name" value="1"/>
</operator>
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall" width="90" x="179" y="136">
<parameter key="name" value="1"/>
</operator>
<connect from_port="single" to_op="Remember" to_port="store"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
</process>
</operator>
<operator activated="false" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (3)" width="90" x="782" y="85">
<parameter key="name" value="%{SocialMedia}"/>
</operator>
<operator activated="false" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (3)" width="90" x="916" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="name"/>
<parameter key="include_special_attributes" value="true"/>
</operator>
<operator activated="true" class="multiply" compatibility="8.2.001" expanded="true" height="208" name="Multiply" width="90" x="916" y="289"/>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Facebook Loop" width="90" x="1117" y="289">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (3)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Facebooks"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (4)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (7)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Facebooks.contains.facebook"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (8)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (6)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (8)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Facebooks.is_not_missing."/>
<parameter key="filters_entry_key" value="Facebooks.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (7)" width="90" x="782" y="238">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (9)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (9)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union" to_port="example set 1"/>
<connect from_op="Recall (9)" from_port="result" to_op="Union" to_port="example set 2"/>
<connect from_op="Union" from_port="union" to_op="Remember (9)" to_port="store"/>
<connect from_op="Remember (9)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (2)" width="90" x="179" y="34">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (2)" to_port="store"/>
<connect from_op="Remember (2)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (3)" width="90" x="983" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (9)" width="90" x="782" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Facebooks"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (17)" width="90" x="983" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (3)" to_port="through 1"/>
<connect from_op="Set Macro (3)" from_port="through 1" to_op="Rename (4)" to_port="example set input"/>
<connect from_op="Rename (4)" from_port="example set output" to_op="Filter Examples (7)" to_port="example set input"/>
<connect from_op="Filter Examples (7)" from_port="example set output" to_op="Append (8)" to_port="example set 1"/>
<connect from_op="Append (8)" from_port="merged set" to_op="Remove Duplicates (6)" to_port="example set input"/>
<connect from_op="Remove Duplicates (6)" from_port="example set output" to_op="Filter Examples (8)" to_port="example set input"/>
<connect from_op="Filter Examples (8)" from_port="example set output" to_op="Select Attributes (9)" to_port="example set input"/>
<connect from_op="Handle Exception (7)" from_port="out 1" to_op="Remember (3)" to_port="store"/>
<connect from_op="Select Attributes (9)" from_port="example set output" to_op="Remove Duplicates (17)" to_port="example set input"/>
<connect from_op="Remove Duplicates (17)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
<description align="center" color="yellow" colored="false" height="105" resized="false" width="180" x="1145" y="717">Type your comment</description>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append" width="90" x="1251" y="289">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (4)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (5)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (2)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (18)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (8)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (8)" to_port="example set 1"/>
<connect from_op="Recall (18)" from_port="result" to_op="Union (8)" to_port="example set 2"/>
<connect from_op="Union (8)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (23)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (2)" to_port="condition"/>
<connect from_op="Branch (2)" from_port="input 1" to_op="Remember (23)" to_port="store"/>
<connect from_op="Remember (23)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (6)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (4)" to_port="collection"/>
<connect from_op="Output (4)" from_port="output 1" to_op="Select (6)" to_port="collection"/>
<connect from_op="Select (6)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Telegram Loop" width="90" x="1117" y="442">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (2)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Telegrams"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (2)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (2)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Telegrams.contains.t\.me"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (2)" width="90" x="380" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (2)" width="90" x="514" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (3)" width="90" x="715" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Telegrams.is_not_missing."/>
<parameter key="filters_entry_key" value="Telegrams.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (2)" width="90" x="782" y="238">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (5)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (2)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (4)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (2)" to_port="example set 1"/>
<connect from_op="Recall (5)" from_port="result" to_op="Union (2)" to_port="example set 2"/>
<connect from_op="Union (2)" from_port="union" to_op="Remember (4)" to_port="store"/>
<connect from_op="Remember (4)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (5)" width="90" x="179" y="34">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (5)" to_port="store"/>
<connect from_op="Remember (5)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (6)" width="90" x="983" y="340">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (2)" width="90" x="916" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Telegrams"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (4)" width="90" x="1050" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Telegrams"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (2)" to_port="through 1"/>
<connect from_op="Set Macro (2)" from_port="through 1" to_op="Rename (2)" to_port="example set input"/>
<connect from_op="Rename (2)" from_port="example set output" to_op="Filter Examples (2)" to_port="example set input"/>
<connect from_op="Filter Examples (2)" from_port="example set output" to_op="Append (2)" to_port="example set 1"/>
<connect from_op="Append (2)" from_port="merged set" to_op="Remove Duplicates (2)" to_port="example set input"/>
<connect from_op="Remove Duplicates (2)" from_port="example set output" to_op="Filter Examples (3)" to_port="example set input"/>
<connect from_op="Filter Examples (3)" from_port="example set output" to_op="Select Attributes (2)" to_port="example set input"/>
<connect from_op="Select Attributes (2)" from_port="example set output" to_op="Remove Duplicates (4)" to_port="example set input"/>
<connect from_op="Remove Duplicates (4)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
<description align="center" color="yellow" colored="false" height="105" resized="false" width="180" x="1145" y="717">Type your comment</description>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (3)" width="90" x="1251" y="442">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (3)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (4)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (4)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (19)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (10)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (10)" to_port="example set 1"/>
<connect from_op="Recall (19)" from_port="result" to_op="Union (10)" to_port="example set 2"/>
<connect from_op="Union (10)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (25)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (4)" to_port="condition"/>
<connect from_op="Branch (4)" from_port="input 1" to_op="Remember (25)" to_port="store"/>
<connect from_op="Remember (25)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (7)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (3)" to_port="collection"/>
<connect from_op="Output (3)" from_port="output 1" to_op="Select (7)" to_port="collection"/>
<connect from_op="Select (7)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Telegrams" width="90" x="1921" y="799">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (6)" width="90" x="45" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (3)" width="90" x="179" y="34">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Telegrams"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (5)" width="90" x="313" y="34">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Telegrams"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_op="Recall (6)" from_port="result" to_op="Select Attributes (3)" to_port="example set input"/>
<connect from_op="Select Attributes (3)" from_port="example set output" to_op="Remove Duplicates (5)" to_port="example set input"/>
<connect from_op="Remove Duplicates (5)" from_port="example set output" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Medium Loop" width="90" x="1117" y="595">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (4)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Mediums"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (3)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (4)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Mediums.contains.medium\.com"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (3)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (7)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (5)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Mediums.is_not_missing."/>
<parameter key="filters_entry_key" value="Mediums.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (3)" width="90" x="782" y="85">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (7)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (3)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (7)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (3)" to_port="example set 1"/>
<connect from_op="Recall (7)" from_port="result" to_op="Union (3)" to_port="example set 2"/>
<connect from_op="Union (3)" from_port="union" to_op="Remember (7)" to_port="store"/>
<connect from_op="Remember (7)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (8)" width="90" x="112" y="136">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (8)" to_port="store"/>
<connect from_op="Remember (8)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (10)" width="90" x="983" y="85">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (10)" width="90" x="715" y="289">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Mediums"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (18)" width="90" x="916" y="289">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Mediums"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (4)" to_port="through 1"/>
<connect from_op="Set Macro (4)" from_port="through 1" to_op="Rename (3)" to_port="example set input"/>
<connect from_op="Rename (3)" from_port="example set output" to_op="Filter Examples (4)" to_port="example set input"/>
<connect from_op="Filter Examples (4)" from_port="example set output" to_op="Append (3)" to_port="example set 1"/>
<connect from_op="Append (3)" from_port="merged set" to_op="Remove Duplicates (7)" to_port="example set input"/>
<connect from_op="Remove Duplicates (7)" from_port="example set output" to_op="Filter Examples (5)" to_port="example set input"/>
<connect from_op="Filter Examples (5)" from_port="example set output" to_op="Select Attributes (10)" to_port="example set input"/>
<connect from_op="Select Attributes (10)" from_port="example set output" to_op="Remove Duplicates (18)" to_port="example set input"/>
<connect from_op="Remove Duplicates (18)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (4)" width="90" x="1251" y="595">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (5)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (8)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (5)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (20)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (11)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (11)" to_port="example set 1"/>
<connect from_op="Recall (20)" from_port="result" to_op="Union (11)" to_port="example set 2"/>
<connect from_op="Union (11)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (26)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (5)" to_port="condition"/>
<connect from_op="Branch (5)" from_port="input 1" to_op="Remember (26)" to_port="store"/>
<connect from_op="Remember (26)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (9)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (5)" to_port="collection"/>
<connect from_op="Output (5)" from_port="output 1" to_op="Select (9)" to_port="collection"/>
<connect from_op="Select (9)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Mediums" width="90" x="1921" y="901">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (8)" width="90" x="45" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (4)" width="90" x="246" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Mediums"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (8)" width="90" x="514" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Mediums"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_op="Recall (8)" from_port="result" to_op="Select Attributes (4)" to_port="example set input"/>
<connect from_op="Select Attributes (4)" from_port="example set output" to_op="Remove Duplicates (8)" to_port="example set input"/>
<connect from_op="Remove Duplicates (8)" from_port="example set output" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="LinkedIns" width="90" x="1117" y="748">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (5)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="LinkedIns"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (5)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (6)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="LinkedIns.contains.linkedin\.com"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (4)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (9)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (9)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="LinkedIns.is_not_missing."/>
<parameter key="filters_entry_key" value="LinkedIns.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (4)" width="90" x="782" y="187">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (10)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (4)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (11)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (4)" to_port="example set 1"/>
<connect from_op="Recall (10)" from_port="result" to_op="Union (4)" to_port="example set 2"/>
<connect from_op="Union (4)" from_port="union" to_op="Remember (11)" to_port="store"/>
<connect from_op="Remember (11)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (12)" width="90" x="112" y="136">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (12)" to_port="store"/>
<connect from_op="Remember (12)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (13)" width="90" x="983" y="85">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (11)" width="90" x="648" y="340">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="LinkedIns"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (19)" width="90" x="916" y="340">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="LinkedIns"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (5)" to_port="through 1"/>
<connect from_op="Set Macro (5)" from_port="through 1" to_op="Rename (5)" to_port="example set input"/>
<connect from_op="Rename (5)" from_port="example set output" to_op="Filter Examples (6)" to_port="example set input"/>
<connect from_op="Filter Examples (6)" from_port="example set output" to_op="Append (4)" to_port="example set 1"/>
<connect from_op="Append (4)" from_port="merged set" to_op="Remove Duplicates (9)" to_port="example set input"/>
<connect from_op="Remove Duplicates (9)" from_port="example set output" to_op="Filter Examples (9)" to_port="example set input"/>
<connect from_op="Filter Examples (9)" from_port="example set output" to_op="Select Attributes (11)" to_port="example set input"/>
<connect from_op="Handle Exception (4)" from_port="out 1" to_op="Remember (13)" to_port="store"/>
<connect from_op="Select Attributes (11)" from_port="example set output" to_op="Remove Duplicates (19)" to_port="example set input"/>
<connect from_op="Remove Duplicates (19)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (5)" width="90" x="1251" y="748">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (6)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (10)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (6)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (21)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (12)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (12)" to_port="example set 1"/>
<connect from_op="Recall (21)" from_port="result" to_op="Union (12)" to_port="example set 2"/>
<connect from_op="Union (12)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (27)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (6)" to_port="condition"/>
<connect from_op="Branch (6)" from_port="input 1" to_op="Remember (27)" to_port="store"/>
<connect from_op="Remember (27)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (11)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (6)" to_port="collection"/>
<connect from_op="Output (6)" from_port="output 1" to_op="Select (11)" to_port="collection"/>
<connect from_op="Select (11)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="LinkedIns (2)" width="90" x="1921" y="1003">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (11)" width="90" x="45" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (5)" width="90" x="246" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="LinkedIns"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (10)" width="90" x="514" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="LinkedIns"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_op="Recall (11)" from_port="result" to_op="Select Attributes (5)" to_port="example set input"/>
<connect from_op="Select Attributes (5)" from_port="example set output" to_op="Remove Duplicates (10)" to_port="example set input"/>
<connect from_op="Remove Duplicates (10)" from_port="example set output" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Twitters (2)" width="90" x="1117" y="901">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (6)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Twitters"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (6)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (10)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Twitters.contains.twitter\.com"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (5)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (11)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (11)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Twitters.is_not_missing."/>
<parameter key="filters_entry_key" value="Twitters.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (5)" width="90" x="782" y="85">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (12)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (5)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (14)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (5)" to_port="example set 1"/>
<connect from_op="Recall (12)" from_port="result" to_op="Union (5)" to_port="example set 2"/>
<connect from_op="Union (5)" from_port="union" to_op="Remember (14)" to_port="store"/>
<connect from_op="Remember (14)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (15)" width="90" x="112" y="136">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (15)" to_port="store"/>
<connect from_op="Remember (15)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (16)" width="90" x="983" y="85">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (12)" width="90" x="581" y="289">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Twitters"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (20)" width="90" x="849" y="289">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Twitters"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (6)" to_port="through 1"/>
<connect from_op="Set Macro (6)" from_port="through 1" to_op="Rename (6)" to_port="example set input"/>
<connect from_op="Rename (6)" from_port="example set output" to_op="Filter Examples (10)" to_port="example set input"/>
<connect from_op="Filter Examples (10)" from_port="example set output" to_op="Append (5)" to_port="example set 1"/>
<connect from_op="Append (5)" from_port="merged set" to_op="Remove Duplicates (11)" to_port="example set input"/>
<connect from_op="Remove Duplicates (11)" from_port="example set output" to_op="Filter Examples (11)" to_port="example set input"/>
<connect from_op="Filter Examples (11)" from_port="example set output" to_op="Select Attributes (12)" to_port="example set input"/>
<connect from_op="Handle Exception (5)" from_port="out 1" to_op="Remember (16)" to_port="store"/>
<connect from_op="Select Attributes (12)" from_port="example set output" to_op="Remove Duplicates (20)" to_port="example set input"/>
<connect from_op="Remove Duplicates (20)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (6)" width="90" x="1251" y="901">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (7)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">

Answers

  • land
    land New Altair Community Member
    Hi,
    I understand your frustration and would really like to understand your problem to help you and avoid it myself. However the process requires nearly a dozen files to be executed. That would require me to completely change the process to be able to execute it.
    Could you please post a simplified, best self-contained process illustrating the problem? Usually not having any files at all by using Generate Data, Generate Data by User Specification or even a combination of Create Document/Write Document/Read CSV would make this much more easy for anybody wanting to help you.

    Greetings,
    Sebastian
  • KM_ALTR
    KM_ALTR
    Altair Employee

    Try 9.0 beta (http://static.rapidminer.com/rnd/html/rapidminer-9.0-preview.html). I just talked to eng and it seems this one might be the fix you have been waiting for.

    Cheers, K.

  • MartinLiebig
    MartinLiebig
    Altair Employee

    Hi,

    it's most likely this bug which is fixed in the latest beta and in 9.0: https://community.rapidminer.com/t5/RapidMiner-Studio-Forum/Possible-bug-with-Aggregate-operator/m-p/52215

  • earmijo
    earmijo New Altair Community Member

    I would never consider helping anybody who titles his/her question the way you did. Manners. Manners. 

     

    The fact that you have 3 answers below just shows how nice the people at RM and in this forum are.