Aggregate function still being a PIECE OF CRAP!! 1 year later, I HATE THIS!

781194025 · July 2018

Everything works fine. Even aggregate.

BUT, it screws up their ID!! Even though its 'group by id'. WHY?!?!?

It should have the social media platforms attached to the proper 'name' , but instead they aggregate fine, concatenate fine, and then end up under some random name!!

Even though it should be 'grouping by ID'.

I attached 2 CSV files so you can use them to test the process!! PLEASE HELP!!!

<?xml version="1.0" encoding="UTF-8"?><process version="8.2.001">
<context>
<input/>
<output/>
<macros/>
</context>
<operator activated="true" class="process" compatibility="8.2.001" expanded="true" name="Process">
<process expanded="true">
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV" width="90" x="112" y="136">
<parameter key="csv_file" value="Z:\items_icodrops.com_4.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role" width="90" x="313" y="136">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (2)" width="90" x="112" y="238">
<parameter key="csv_file" value="Z:\items_icodrops.com_5.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (2)" width="90" x="313" y="238">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (3)" width="90" x="112" y="340">
<parameter key="csv_file" value="Z:\items_icodrops.com_7.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (3)" width="90" x="313" y="340">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (4)" width="90" x="112" y="442">
<parameter key="csv_file" value="Z:\items_icodrops.com_8.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (4)" width="90" x="313" y="442">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (5)" width="90" x="112" y="544">
<parameter key="csv_file" value="Z:\items_icodrops.com_9.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (5)" width="90" x="313" y="544">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="read_csv" compatibility="8.2.001" expanded="true" height="68" name="Read CSV (6)" width="90" x="112" y="646">
<parameter key="csv_file" value="Z:\items_icodrops.com_10.csv"/>
<parameter key="column_separators" value=","/>
<parameter key="first_row_as_names" value="false"/>
<list key="annotations">
<parameter key="0" value="Name"/>
</list>
<list key="data_set_meta_data_information">
<parameter key="0" value="_cached_page_id.true.polynominal.attribute"/>
<parameter key="1" value="_template.true.polynominal.attribute"/>
<parameter key="2" value="_type.true.polynominal.attribute"/>
<parameter key="3" value="about.true.polynominal.attribute"/>
<parameter key="4" value="bitcointalk.true.polynominal.attribute"/>
<parameter key="5" value="facebook.true.polynominal.attribute"/>
<parameter key="6" value="field2.true.polynominal.attribute"/>
<parameter key="7" value="medium.true.polynominal.attribute"/>
<parameter key="8" value="name.true.polynominal.attribute"/>
<parameter key="9" value="reddit.true.polynominal.attribute"/>
<parameter key="10" value="telegram.true.polynominal.attribute"/>
<parameter key="11" value="twitter.true.polynominal.attribute"/>
<parameter key="12" value="url.true.polynominal.attribute"/>
<parameter key="13" value="youtub.true.polynominal.attribute"/>
</list>
</operator>
<operator activated="true" class="set_role" compatibility="8.2.001" expanded="true" height="82" name="Set Role (6)" width="90" x="313" y="646">
<parameter key="attribute_name" value="name"/>
<parameter key="target_role" value="id"/>
<list key="set_additional_roles"/>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="187" name="Append" width="90" x="514" y="289"/>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes" width="90" x="648" y="289">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attributes" value="_cached_page_id|_template|_type"/>
<parameter key="invert_selection" value="true"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates" width="90" x="782" y="289">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="name"/>
<parameter key="include_special_attributes" value="true"/>
</operator>
<operator activated="false" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Loop Collection" width="90" x="2122" y="1207">
<parameter key="unfold" value="true"/>
<process expanded="true">
<connect from_port="single" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="loop_collection" compatibility="8.2.001" expanded="true" height="68" name="Loop Collection (2)" width="90" x="2055" y="1054">
<parameter key="set_iteration_macro" value="true"/>
<parameter key="unfold" value="true"/>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember" width="90" x="179" y="34">
<parameter key="name" value="1"/>
</operator>
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall" width="90" x="179" y="136">
<parameter key="name" value="1"/>
</operator>
<connect from_port="single" to_op="Remember" to_port="store"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
</process>
</operator>
<operator activated="false" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (3)" width="90" x="782" y="85">
<parameter key="name" value="%{SocialMedia}"/>
</operator>
<operator activated="false" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (3)" width="90" x="916" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="name"/>
<parameter key="include_special_attributes" value="true"/>
</operator>
<operator activated="true" class="multiply" compatibility="8.2.001" expanded="true" height="208" name="Multiply" width="90" x="916" y="289"/>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Facebook Loop" width="90" x="1117" y="289">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (3)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Facebooks"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (4)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (7)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Facebooks.contains.facebook"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (8)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (6)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (8)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Facebooks.is_not_missing."/>
<parameter key="filters_entry_key" value="Facebooks.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (7)" width="90" x="782" y="238">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (9)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (9)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union" to_port="example set 1"/>
<connect from_op="Recall (9)" from_port="result" to_op="Union" to_port="example set 2"/>
<connect from_op="Union" from_port="union" to_op="Remember (9)" to_port="store"/>
<connect from_op="Remember (9)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (2)" width="90" x="179" y="34">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (2)" to_port="store"/>
<connect from_op="Remember (2)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (3)" width="90" x="983" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (9)" width="90" x="782" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Facebooks"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (17)" width="90" x="983" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (3)" to_port="through 1"/>
<connect from_op="Set Macro (3)" from_port="through 1" to_op="Rename (4)" to_port="example set input"/>
<connect from_op="Rename (4)" from_port="example set output" to_op="Filter Examples (7)" to_port="example set input"/>
<connect from_op="Filter Examples (7)" from_port="example set output" to_op="Append (8)" to_port="example set 1"/>
<connect from_op="Append (8)" from_port="merged set" to_op="Remove Duplicates (6)" to_port="example set input"/>
<connect from_op="Remove Duplicates (6)" from_port="example set output" to_op="Filter Examples (8)" to_port="example set input"/>
<connect from_op="Filter Examples (8)" from_port="example set output" to_op="Select Attributes (9)" to_port="example set input"/>
<connect from_op="Handle Exception (7)" from_port="out 1" to_op="Remember (3)" to_port="store"/>
<connect from_op="Select Attributes (9)" from_port="example set output" to_op="Remove Duplicates (17)" to_port="example set input"/>
<connect from_op="Remove Duplicates (17)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
<description align="center" color="yellow" colored="false" height="105" resized="false" width="180" x="1145" y="717">Type your comment</description>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append" width="90" x="1251" y="289">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (4)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (5)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (2)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (18)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (8)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (8)" to_port="example set 1"/>
<connect from_op="Recall (18)" from_port="result" to_op="Union (8)" to_port="example set 2"/>
<connect from_op="Union (8)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (23)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (2)" to_port="condition"/>
<connect from_op="Branch (2)" from_port="input 1" to_op="Remember (23)" to_port="store"/>
<connect from_op="Remember (23)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (6)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (4)" to_port="collection"/>
<connect from_op="Output (4)" from_port="output 1" to_op="Select (6)" to_port="collection"/>
<connect from_op="Select (6)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Telegram Loop" width="90" x="1117" y="442">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (2)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Telegrams"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (2)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (2)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Telegrams.contains.t\.me"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (2)" width="90" x="380" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (2)" width="90" x="514" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (3)" width="90" x="715" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Telegrams.is_not_missing."/>
<parameter key="filters_entry_key" value="Telegrams.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (2)" width="90" x="782" y="238">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (5)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (2)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (4)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (2)" to_port="example set 1"/>
<connect from_op="Recall (5)" from_port="result" to_op="Union (2)" to_port="example set 2"/>
<connect from_op="Union (2)" from_port="union" to_op="Remember (4)" to_port="store"/>
<connect from_op="Remember (4)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (5)" width="90" x="179" y="34">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (5)" to_port="store"/>
<connect from_op="Remember (5)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (6)" width="90" x="983" y="340">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (2)" width="90" x="916" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Telegrams"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (4)" width="90" x="1050" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Telegrams"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (2)" to_port="through 1"/>
<connect from_op="Set Macro (2)" from_port="through 1" to_op="Rename (2)" to_port="example set input"/>
<connect from_op="Rename (2)" from_port="example set output" to_op="Filter Examples (2)" to_port="example set input"/>
<connect from_op="Filter Examples (2)" from_port="example set output" to_op="Append (2)" to_port="example set 1"/>
<connect from_op="Append (2)" from_port="merged set" to_op="Remove Duplicates (2)" to_port="example set input"/>
<connect from_op="Remove Duplicates (2)" from_port="example set output" to_op="Filter Examples (3)" to_port="example set input"/>
<connect from_op="Filter Examples (3)" from_port="example set output" to_op="Select Attributes (2)" to_port="example set input"/>
<connect from_op="Select Attributes (2)" from_port="example set output" to_op="Remove Duplicates (4)" to_port="example set input"/>
<connect from_op="Remove Duplicates (4)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
<description align="center" color="yellow" colored="false" height="105" resized="false" width="180" x="1145" y="717">Type your comment</description>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (3)" width="90" x="1251" y="442">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (3)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (4)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (4)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (19)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (10)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (10)" to_port="example set 1"/>
<connect from_op="Recall (19)" from_port="result" to_op="Union (10)" to_port="example set 2"/>
<connect from_op="Union (10)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (25)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (4)" to_port="condition"/>
<connect from_op="Branch (4)" from_port="input 1" to_op="Remember (25)" to_port="store"/>
<connect from_op="Remember (25)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (7)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (3)" to_port="collection"/>
<connect from_op="Output (3)" from_port="output 1" to_op="Select (7)" to_port="collection"/>
<connect from_op="Select (7)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Telegrams" width="90" x="1921" y="799">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (6)" width="90" x="45" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (3)" width="90" x="179" y="34">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Telegrams"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (5)" width="90" x="313" y="34">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Telegrams"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_op="Recall (6)" from_port="result" to_op="Select Attributes (3)" to_port="example set input"/>
<connect from_op="Select Attributes (3)" from_port="example set output" to_op="Remove Duplicates (5)" to_port="example set input"/>
<connect from_op="Remove Duplicates (5)" from_port="example set output" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Medium Loop" width="90" x="1117" y="595">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (4)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Mediums"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (3)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (4)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Mediums.contains.medium\.com"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (3)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (7)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (5)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Mediums.is_not_missing."/>
<parameter key="filters_entry_key" value="Mediums.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (3)" width="90" x="782" y="85">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (7)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (3)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (7)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (3)" to_port="example set 1"/>
<connect from_op="Recall (7)" from_port="result" to_op="Union (3)" to_port="example set 2"/>
<connect from_op="Union (3)" from_port="union" to_op="Remember (7)" to_port="store"/>
<connect from_op="Remember (7)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (8)" width="90" x="112" y="136">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (8)" to_port="store"/>
<connect from_op="Remember (8)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (10)" width="90" x="983" y="85">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (10)" width="90" x="715" y="289">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Mediums"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (18)" width="90" x="916" y="289">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Mediums"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (4)" to_port="through 1"/>
<connect from_op="Set Macro (4)" from_port="through 1" to_op="Rename (3)" to_port="example set input"/>
<connect from_op="Rename (3)" from_port="example set output" to_op="Filter Examples (4)" to_port="example set input"/>
<connect from_op="Filter Examples (4)" from_port="example set output" to_op="Append (3)" to_port="example set 1"/>
<connect from_op="Append (3)" from_port="merged set" to_op="Remove Duplicates (7)" to_port="example set input"/>
<connect from_op="Remove Duplicates (7)" from_port="example set output" to_op="Filter Examples (5)" to_port="example set input"/>
<connect from_op="Filter Examples (5)" from_port="example set output" to_op="Select Attributes (10)" to_port="example set input"/>
<connect from_op="Select Attributes (10)" from_port="example set output" to_op="Remove Duplicates (18)" to_port="example set input"/>
<connect from_op="Remove Duplicates (18)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (4)" width="90" x="1251" y="595">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (5)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (8)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (5)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (20)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (11)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (11)" to_port="example set 1"/>
<connect from_op="Recall (20)" from_port="result" to_op="Union (11)" to_port="example set 2"/>
<connect from_op="Union (11)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (26)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (5)" to_port="condition"/>
<connect from_op="Branch (5)" from_port="input 1" to_op="Remember (26)" to_port="store"/>
<connect from_op="Remember (26)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (9)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (5)" to_port="collection"/>
<connect from_op="Output (5)" from_port="output 1" to_op="Select (9)" to_port="collection"/>
<connect from_op="Select (9)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Mediums" width="90" x="1921" y="901">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (8)" width="90" x="45" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (4)" width="90" x="246" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Mediums"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (8)" width="90" x="514" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Mediums"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_op="Recall (8)" from_port="result" to_op="Select Attributes (4)" to_port="example set input"/>
<connect from_op="Select Attributes (4)" from_port="example set output" to_op="Remove Duplicates (8)" to_port="example set input"/>
<connect from_op="Remove Duplicates (8)" from_port="example set output" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="LinkedIns" width="90" x="1117" y="748">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (5)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="LinkedIns"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (5)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (6)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="LinkedIns.contains.linkedin\.com"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (4)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (9)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (9)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="LinkedIns.is_not_missing."/>
<parameter key="filters_entry_key" value="LinkedIns.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (4)" width="90" x="782" y="187">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (10)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (4)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (11)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (4)" to_port="example set 1"/>
<connect from_op="Recall (10)" from_port="result" to_op="Union (4)" to_port="example set 2"/>
<connect from_op="Union (4)" from_port="union" to_op="Remember (11)" to_port="store"/>
<connect from_op="Remember (11)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (12)" width="90" x="112" y="136">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (12)" to_port="store"/>
<connect from_op="Remember (12)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (13)" width="90" x="983" y="85">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (11)" width="90" x="648" y="340">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="LinkedIns"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (19)" width="90" x="916" y="340">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="LinkedIns"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (5)" to_port="through 1"/>
<connect from_op="Set Macro (5)" from_port="through 1" to_op="Rename (5)" to_port="example set input"/>
<connect from_op="Rename (5)" from_port="example set output" to_op="Filter Examples (6)" to_port="example set input"/>
<connect from_op="Filter Examples (6)" from_port="example set output" to_op="Append (4)" to_port="example set 1"/>
<connect from_op="Append (4)" from_port="merged set" to_op="Remove Duplicates (9)" to_port="example set input"/>
<connect from_op="Remove Duplicates (9)" from_port="example set output" to_op="Filter Examples (9)" to_port="example set input"/>
<connect from_op="Filter Examples (9)" from_port="example set output" to_op="Select Attributes (11)" to_port="example set input"/>
<connect from_op="Handle Exception (4)" from_port="out 1" to_op="Remember (13)" to_port="store"/>
<connect from_op="Select Attributes (11)" from_port="example set output" to_op="Remove Duplicates (19)" to_port="example set input"/>
<connect from_op="Remove Duplicates (19)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (5)" width="90" x="1251" y="748">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (6)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">
<operator activated="false" breakpoints="after" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (10)" width="90" x="112" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<operator activated="true" class="branch" compatibility="8.2.001" expanded="true" height="82" name="Branch (6)" width="90" x="313" y="34">
<parameter key="condition_type" value="expression"/>
<parameter key="expression" value="%{iteration}==1"/>
<process expanded="true">
<connect from_port="condition" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (21)" width="90" x="45" y="187">
<parameter key="name" value="LoopData"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (12)" width="90" x="179" y="34"/>
<connect from_port="condition" to_op="Union (12)" to_port="example set 1"/>
<connect from_op="Recall (21)" from_port="result" to_op="Union (12)" to_port="example set 2"/>
<connect from_op="Union (12)" from_port="union" to_port="input 1"/>
<portSpacing port="source_condition" spacing="0"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="sink_input 1" spacing="0"/>
<portSpacing port="sink_input 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (27)" width="90" x="581" y="34">
<parameter key="name" value="LoopData"/>
</operator>
<connect from_port="single" to_op="Branch (6)" to_port="condition"/>
<connect from_op="Branch (6)" from_port="input 1" to_op="Remember (27)" to_port="store"/>
<connect from_op="Remember (27)" from_port="stored" to_port="output 1"/>
<portSpacing port="source_single" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="select" compatibility="8.2.001" expanded="true" height="68" name="Select (11)" width="90" x="380" y="34">
<parameter key="index" value="%{iteration}"/>
</operator>
<connect from_port="in 1" to_op="Output (6)" to_port="collection"/>
<connect from_op="Output (6)" from_port="output 1" to_op="Select (11)" to_port="collection"/>
<connect from_op="Select (11)" from_port="selected" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="LinkedIns (2)" width="90" x="1921" y="1003">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (11)" width="90" x="45" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (5)" width="90" x="246" y="85">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="LinkedIns"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (10)" width="90" x="514" y="85">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="LinkedIns"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_op="Recall (11)" from_port="result" to_op="Select Attributes (5)" to_port="example set input"/>
<connect from_op="Select Attributes (5)" from_port="example set output" to_op="Remove Duplicates (10)" to_port="example set input"/>
<connect from_op="Remove Duplicates (10)" from_port="example set output" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="concurrency:loop_attributes" compatibility="8.2.001" expanded="true" height="82" name="Twitters (2)" width="90" x="1117" y="901">
<process expanded="true">
<operator activated="true" class="set_macro" compatibility="8.2.001" expanded="true" height="82" name="Set Macro (6)" width="90" x="45" y="289">
<parameter key="macro" value="SocialMedia"/>
<parameter key="value" value="Twitters"/>
</operator>
<operator activated="true" class="rename" compatibility="8.2.001" expanded="true" height="82" name="Rename (6)" width="90" x="179" y="289">
<parameter key="old_name" value="%{loop_attribute}"/>
<parameter key="new_name" value="%{SocialMedia}"/>
<list key="rename_additional_attributes"/>
</operator>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (10)" width="90" x="179" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Twitters.contains.twitter\.com"/>
</list>
</operator>
<operator activated="true" class="append" compatibility="8.2.001" expanded="true" height="82" name="Append (5)" width="90" x="313" y="85"/>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (11)" width="90" x="447" y="85"/>
<operator activated="true" class="filter_examples" compatibility="8.2.001" expanded="true" height="103" name="Filter Examples (11)" width="90" x="581" y="85">
<list key="filters_list">
<parameter key="filters_entry_key" value="Twitters.is_not_missing."/>
<parameter key="filters_entry_key" value="Twitters.does_not_equal.?"/>
</list>
</operator>
<operator activated="false" class="handle_exception" compatibility="8.2.001" expanded="true" height="82" name="Handle Exception (5)" width="90" x="782" y="85">
<process expanded="true">
<operator activated="true" class="recall" compatibility="8.2.001" expanded="true" height="68" name="Recall (12)" width="90" x="112" y="238">
<parameter key="name" value="%{SocialMedia}Collection"/>
<parameter key="remove_from_store" value="false"/>
</operator>
<operator activated="true" class="union" compatibility="8.2.001" expanded="true" height="82" name="Union (5)" width="90" x="246" y="34"/>
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (14)" width="90" x="380" y="34">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<connect from_port="in 1" to_op="Union (5)" to_port="example set 1"/>
<connect from_op="Recall (12)" from_port="result" to_op="Union (5)" to_port="example set 2"/>
<connect from_op="Union (5)" from_port="union" to_op="Remember (14)" to_port="store"/>
<connect from_op="Remember (14)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
<process expanded="true">
<operator activated="true" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (15)" width="90" x="112" y="136">
<parameter key="name" value="%{SocialMedia}LastRun"/>
</operator>
<connect from_port="in 1" to_op="Remember (15)" to_port="store"/>
<connect from_op="Remember (15)" from_port="stored" to_port="out 1"/>
<portSpacing port="source_in 1" spacing="0"/>
<portSpacing port="source_in 2" spacing="0"/>
<portSpacing port="sink_out 1" spacing="0"/>
<portSpacing port="sink_out 2" spacing="0"/>
</process>
</operator>
<operator activated="false" class="remember" compatibility="8.2.001" expanded="true" height="68" name="Remember (16)" width="90" x="983" y="85">
<parameter key="name" value="%{SocialMedia}Collection"/>
</operator>
<operator activated="true" class="select_attributes" compatibility="8.2.001" expanded="true" height="82" name="Select Attributes (12)" width="90" x="581" y="289">
<parameter key="attribute_filter_type" value="subset"/>
<parameter key="attribute" value="Facebooks"/>
<parameter key="attributes" value="Twitters"/>
</operator>
<operator activated="true" class="remove_duplicates" compatibility="8.2.001" expanded="true" height="103" name="Remove Duplicates (20)" width="90" x="849" y="289">
<parameter key="attribute_filter_type" value="single"/>
<parameter key="attribute" value="Twitters"/>
<parameter key="treat_missing_values_as_duplicates" value="true"/>
</operator>
<connect from_port="input 1" to_op="Set Macro (6)" to_port="through 1"/>
<connect from_op="Set Macro (6)" from_port="through 1" to_op="Rename (6)" to_port="example set input"/>
<connect from_op="Rename (6)" from_port="example set output" to_op="Filter Examples (10)" to_port="example set input"/>
<connect from_op="Filter Examples (10)" from_port="example set output" to_op="Append (5)" to_port="example set 1"/>
<connect from_op="Append (5)" from_port="merged set" to_op="Remove Duplicates (11)" to_port="example set input"/>
<connect from_op="Remove Duplicates (11)" from_port="example set output" to_op="Filter Examples (11)" to_port="example set input"/>
<connect from_op="Filter Examples (11)" from_port="example set output" to_op="Select Attributes (12)" to_port="example set input"/>
<connect from_op="Handle Exception (5)" from_port="out 1" to_op="Remember (16)" to_port="store"/>
<connect from_op="Select Attributes (12)" from_port="example set output" to_op="Remove Duplicates (20)" to_port="example set input"/>
<connect from_op="Remove Duplicates (20)" from_port="example set output" to_port="output 1"/>
<portSpacing port="source_input 1" spacing="0"/>
<portSpacing port="source_input 2" spacing="0"/>
<portSpacing port="sink_output 1" spacing="0"/>
<portSpacing port="sink_output 2" spacing="0"/>
</process>
</operator>
<operator activated="true" class="subprocess" compatibility="8.2.001" expanded="true" height="82" name="Union Append (6)" width="90" x="1251" y="901">
<process expanded="true">
<operator activated="true" class="loop_collection" compatibility="8.2.001" expanded="true" height="82" name="Output (7)" width="90" x="179" y="34">
<parameter key="set_iteration_macro" value="true"/>
<process expanded="true">

land · July 2018

Hi,
I understand your frustration and would really like to understand your problem to help you and avoid it myself. However the process requires nearly a dozen files to be executed. That would require me to completely change the process to be able to execute it.
Could you please post a simplified, best self-contained process illustrating the problem? Usually not having any files at all by using Generate Data, Generate Data by User Specification or even a combination of Create Document/Write Document/Read CSV would make this much more easy for anybody wanting to help you.

Greetings,
Sebastian

KM_ALTR · August 2018

Try 9.0 beta (http://static.rapidminer.com/rnd/html/rapidminer-9.0-preview.html). I just talked to eng and it seems this one might be the fix you have been waiting for.

Cheers, K.

MartinLiebig · August 2018

Hi,

it's most likely this bug which is fixed in the latest beta and in 9.0: https://community.rapidminer.com/t5/RapidMiner-Studio-Forum/Possible-bug-with-Aggregate-operator/m-p/52215

earmijo · August 2018

I would never consider helping anybody who titles his/her question the way you did. Manners. Manners.

The fact that you have 3 answers below just shows how nice the people at RM and in this forum are.

Aggregate function still being a PIECE OF CRAP!! 1 year later, I HATE THIS!

Answers

Categories