Looping through a filter and save every iteration

MPB_

Hello,

I already searched the forum but the given processes seem to be outdated and not compatible with the most recent version of RM.

I have a big dataset with sales-data of many products, many supermarkets, many weeks....

I would like to loop thorugh a filter in a way that for every value of the column "UPC" (=Universal Product Code) a new exampleset is stored.

Is that possible?

My process looks like this:

<div><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="retrieve" compatibility="9.5.000" expanded="true" height="68" name="Retrieve FINALJOIN" width="90" x="112" y="34"><br>&nbsp;&nbsp;&nbsp; <parameter key="repository_entry" value="../../data/Join/FINALJOIN"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="select_attributes" compatibility="9.5.000" expanded="true" height="82" name="Select Attributes" width="90" x="246" y="34"><br>&nbsp;&nbsp;&nbsp; <parameter key="attribute_filter_type" value="subset"/><br>&nbsp;&nbsp;&nbsp; <parameter key="attribute" value=""/><br>&nbsp;&nbsp;&nbsp; <parameter key="attributes" value="IRI_KEY|L1|L2|BRAND|UPC|WEEK|PRICE_PER_UNIT"/><br>&nbsp;&nbsp;&nbsp; <parameter key="use_except_expression" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="value_type" value="attribute_value"/><br>&nbsp;&nbsp;&nbsp; <parameter key="use_value_type_exception" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="except_value_type" value="time"/><br>&nbsp;&nbsp;&nbsp; <parameter key="block_type" value="attribute_block"/><br>&nbsp;&nbsp;&nbsp; <parameter key="use_block_type_exception" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="except_block_type" value="value_matrix_row_start"/><br>&nbsp;&nbsp;&nbsp; <parameter key="invert_selection" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="include_special_attributes" value="false"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="generate_attributes" compatibility="9.5.000" expanded="true" height="82" name="Generate Attributes" width="90" x="380" y="34"><br>&nbsp;&nbsp;&nbsp; <list key="function_descriptions"><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <parameter key="IRI2" value="&quot;Markt&quot;+IRI_KEY"/><br>&nbsp;&nbsp;&nbsp; </list><br>&nbsp;&nbsp;&nbsp; <parameter key="keep_all" value="true"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="filter_examples" compatibility="9.5.000" expanded="true" height="103" name="Ketchup" width="90" x="514" y="34"><br>&nbsp;&nbsp;&nbsp; <parameter key="parameter_expression" value=""/><br>&nbsp;&nbsp;&nbsp; <parameter key="condition_class" value="custom_filters"/><br>&nbsp;&nbsp;&nbsp; <parameter key="invert_filter" value="false"/><br>&nbsp;&nbsp;&nbsp; <list key="filters_list"><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <parameter key="filters_entry_key" value="L2.equals.KETCHUP"/><br>&nbsp;&nbsp;&nbsp; </list><br>&nbsp;&nbsp;&nbsp; <parameter key="filters_logic_and" value="true"/><br>&nbsp;&nbsp;&nbsp; <parameter key="filters_check_metadata" value="true"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="filter_examples" compatibility="9.5.000" expanded="true" height="103" name="UPC" width="90" x="648" y="34"><br>&nbsp;&nbsp;&nbsp; <parameter key="parameter_expression" value=""/><br>&nbsp;&nbsp;&nbsp; <parameter key="condition_class" value="custom_filters"/><br>&nbsp;&nbsp;&nbsp; <parameter key="invert_filter" value="false"/><br>&nbsp;&nbsp;&nbsp; <list key="filters_list"><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <parameter key="filters_entry_key" value="UPC.equals.00-01-13000-00121"/><br>&nbsp;&nbsp;&nbsp; </list><br>&nbsp;&nbsp;&nbsp; <parameter key="filters_logic_and" value="true"/><br>&nbsp;&nbsp;&nbsp; <parameter key="filters_check_metadata" value="true"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="retrieve" compatibility="9.5.000" expanded="true" height="68" name="Retrieve A1" width="90" x="112" y="238"><br>&nbsp;&nbsp;&nbsp; <parameter key="repository_entry" value="../../data/prei_vorwoche/A1"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="format_numbers" compatibility="9.5.000" expanded="true" height="82" name="Format Numbers" width="90" x="246" y="238"><br>&nbsp;&nbsp;&nbsp; <parameter key="attribute_filter_type" value="single"/><br>&nbsp;&nbsp;&nbsp; <parameter key="attribute" value="PRICE_PER_UNIT"/><br>&nbsp;&nbsp;&nbsp; <parameter key="attributes" value=""/><br>&nbsp;&nbsp;&nbsp; <parameter key="use_except_expression" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="value_type" value="numeric"/><br>&nbsp;&nbsp;&nbsp; <parameter key="use_value_type_exception" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="except_value_type" value="real"/><br>&nbsp;&nbsp;&nbsp; <parameter key="block_type" value="value_series"/><br>&nbsp;&nbsp;&nbsp; <parameter key="use_block_type_exception" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="except_block_type" value="value_series_end"/><br>&nbsp;&nbsp;&nbsp; <parameter key="invert_selection" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="include_special_attributes" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="format_type" value="currency"/><br>&nbsp;&nbsp;&nbsp; <parameter key="locale" value="English (United States)"/><br>&nbsp;&nbsp;&nbsp; <parameter key="use_grouping" value="false"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="write_csv" compatibility="9.5.000" expanded="true" height="82" name="Write CSV" width="90" x="380" y="238"><br>&nbsp;&nbsp;&nbsp; <parameter key="csv_file" value="D:\Master_Arbeit\A1.csv"/><br>&nbsp;&nbsp;&nbsp; <parameter key="column_separator" value=";"/><br>&nbsp;&nbsp;&nbsp; <parameter key="write_attribute_names" value="true"/><br>&nbsp;&nbsp;&nbsp; <parameter key="quote_nominal_values" value="true"/><br>&nbsp;&nbsp;&nbsp; <parameter key="format_date_attributes" value="true"/><br>&nbsp;&nbsp;&nbsp; <parameter key="append_to_file" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="encoding" value="SYSTEM"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="read_csv" compatibility="9.5.000" expanded="true" height="68" name="Read CSV" width="90" x="45" y="340"><br>&nbsp;&nbsp;&nbsp; <parameter key="csv_file" value="D:\Master_Arbeit\A1.csv"/><br>&nbsp;&nbsp;&nbsp; <parameter key="column_separators" value=";"/><br>&nbsp;&nbsp;&nbsp; <parameter key="trim_lines" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="use_quotes" value="true"/><br>&nbsp;&nbsp;&nbsp; <parameter key="quotes_character" value="&quot;"/><br>&nbsp;&nbsp;&nbsp; <parameter key="escape_character" value="\"/><br>&nbsp;&nbsp;&nbsp; <parameter key="skip_comments" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="comment_characters" value="#"/><br>&nbsp;&nbsp;&nbsp; <parameter key="starting_row" value="1"/><br>&nbsp;&nbsp;&nbsp; <parameter key="parse_numbers" value="true"/><br>&nbsp;&nbsp;&nbsp; <parameter key="decimal_character" value="."/><br>&nbsp;&nbsp;&nbsp; <parameter key="grouped_digits" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="grouping_character" value=","/><br>&nbsp;&nbsp;&nbsp; <parameter key="infinity_representation" value=""/><br>&nbsp;&nbsp;&nbsp; <parameter key="date_format" value=""/><br>&nbsp;&nbsp;&nbsp; <parameter key="first_row_as_names" value="true"/><br>&nbsp;&nbsp;&nbsp; <list key="annotations"/><br>&nbsp;&nbsp;&nbsp; <parameter key="time_zone" value="SYSTEM"/><br>&nbsp;&nbsp;&nbsp; <parameter key="locale" value="English (United States)"/><br>&nbsp;&nbsp;&nbsp; <parameter key="encoding" value="SYSTEM"/><br>&nbsp;&nbsp;&nbsp; <parameter key="read_all_values_as_polynominal" value="false"/><br>&nbsp;&nbsp;&nbsp; <list key="data_set_meta_data_information"/><br>&nbsp;&nbsp;&nbsp; <parameter key="read_not_matching_values_as_missings" value="true"/><br>&nbsp;&nbsp;&nbsp; <parameter key="datamanagement" value="double_array"/><br>&nbsp;&nbsp;&nbsp; <parameter key="data_management" value="auto"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="store" compatibility="9.5.000" expanded="true" height="68" name="Store (2)" width="90" x="179" y="340"><br>&nbsp;&nbsp;&nbsp; <parameter key="repository_entry" value="../../data/prei_vorwoche/A2"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="retrieve" compatibility="9.5.000" expanded="true" height="68" name="Retrieve" width="90" x="313" y="340"><br>&nbsp;&nbsp;&nbsp; <parameter key="repository_entry" value="../../data/prei_vorwoche/A2"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="filter_examples" compatibility="9.5.000" expanded="true" height="103" name="MARKTFILTER" width="90" x="447" y="340"><br>&nbsp;&nbsp;&nbsp; <parameter key="parameter_expression" value=""/><br>&nbsp;&nbsp;&nbsp; <parameter key="condition_class" value="custom_filters"/><br>&nbsp;&nbsp;&nbsp; <parameter key="invert_filter" value="false"/><br>&nbsp;&nbsp;&nbsp; <list key="filters_list"><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <parameter key="filters_entry_key" value="IRI2.equals.Markt1078045"/><br>&nbsp;&nbsp;&nbsp; </list><br>&nbsp;&nbsp;&nbsp; <parameter key="filters_logic_and" value="true"/><br>&nbsp;&nbsp;&nbsp; <parameter key="filters_check_metadata" value="true"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="store" compatibility="9.5.000" expanded="true" height="68" name="Store (3)" width="90" x="581" y="340"><br>&nbsp;&nbsp;&nbsp; <parameter key="repository_entry" value="../../data/prei_vorwoche/Dollar"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="time_series:lag_series" compatibility="9.5.000" expanded="true" height="82" name="Lag" width="90" x="112" y="442"><br>&nbsp;&nbsp;&nbsp; <list key="attributes"><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <parameter key="PRICE_PER_UNIT" value="1"/><br>&nbsp;&nbsp;&nbsp; </list><br>&nbsp;&nbsp;&nbsp; <parameter key="overwrite_attributes" value="false"/><br>&nbsp;&nbsp;&nbsp; <parameter key="extend_exampleset" value="false"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="generate_attributes" compatibility="9.5.000" expanded="true" height="82" name="Generate Attributes (4)" width="90" x="246" y="493"><br>&nbsp;&nbsp;&nbsp; <list key="function_descriptions"><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <parameter key="UP" value="cut(PRICE_PER_UNIT,1,4)"/><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <parameter key="UP-1" value="cut([PRICE_PER_UNIT-1],1,4)"/><br>&nbsp;&nbsp;&nbsp; </list><br>&nbsp;&nbsp;&nbsp; <parameter key="keep_all" value="true"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="store" compatibility="9.5.000" expanded="true" height="68" name="Store (5)" width="90" x="380" y="493"><br>&nbsp;&nbsp;&nbsp; <parameter key="repository_entry" value="A3"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="write_excel" compatibility="9.5.000" expanded="true" height="103" name="Write Excel" width="90" x="514" y="493"><br>&nbsp;&nbsp;&nbsp; <parameter key="excel_file" value="D:\Master_Arbeit\A3.xlsx"/><br>&nbsp;&nbsp;&nbsp; <parameter key="file_format" value="xlsx"/><br>&nbsp;&nbsp;&nbsp; <enumeration key="sheet_names"/><br>&nbsp;&nbsp;&nbsp; <parameter key="sheet_name" value="RapidMiner Data"/><br>&nbsp;&nbsp;&nbsp; <parameter key="date_format" value="yyyy-MM-dd HH:mm:ss"/><br>&nbsp;&nbsp;&nbsp; <parameter key="number_format" value="#.0"/><br>&nbsp;&nbsp;&nbsp; <parameter key="encoding" value="SYSTEM"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="read_excel" compatibility="9.5.000" expanded="true" height="68" name="Read Excel" width="90" x="112" y="595"><br>&nbsp;&nbsp;&nbsp; <parameter key="excel_file" value="D:\Master_Arbeit\A3.xlsx"/><br>&nbsp;&nbsp;&nbsp; <parameter key="sheet_selection" value="sheet number"/><br>&nbsp;&nbsp;&nbsp; <parameter key="sheet_number" value="1"/><br>&nbsp;&nbsp;&nbsp; <parameter key="imported_cell_range" value="A1"/><br>&nbsp;&nbsp;&nbsp; <parameter key="encoding" value="SYSTEM"/><br>&nbsp;&nbsp;&nbsp; <parameter key="first_row_as_names" value="true"/><br>&nbsp;&nbsp;&nbsp; <list key="annotations"/><br>&nbsp;&nbsp;&nbsp; <parameter key="date_format" value=""/><br>&nbsp;&nbsp;&nbsp; <parameter key="time_zone" value="SYSTEM"/><br>&nbsp;&nbsp;&nbsp; <parameter key="locale" value="English (United States)"/><br>&nbsp;&nbsp;&nbsp; <parameter key="read_all_values_as_polynominal" value="false"/><br>&nbsp;&nbsp;&nbsp; <list key="data_set_meta_data_information"/><br>&nbsp;&nbsp;&nbsp; <parameter key="read_not_matching_values_as_missings" value="true"/><br>&nbsp;&nbsp;&nbsp; <parameter key="datamanagement" value="double_array"/><br>&nbsp;&nbsp;&nbsp; <parameter key="data_management" value="auto"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="generate_attributes" compatibility="9.5.000" expanded="true" height="82" name="Generate Attributes (3)" width="90" x="313" y="595"><br>&nbsp;&nbsp;&nbsp; <list key="function_descriptions"><br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <parameter key="DeltaPrice" value="[UP-1]-UP"/><br>&nbsp;&nbsp;&nbsp; </list><br>&nbsp;&nbsp;&nbsp; <parameter key="keep_all" value="true"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="store" compatibility="9.5.000" expanded="true" height="68" name="Store (4)" width="90" x="447" y="595"><br>&nbsp;&nbsp;&nbsp; <parameter key="repository_entry" value="../../data/prei_vorwoche/dollar_lag"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="sort" compatibility="9.5.000" expanded="true" height="82" name="Sort by Week" width="90" x="581" y="187"><br>&nbsp;&nbsp;&nbsp; <parameter key="attribute_name" value="WEEK"/><br>&nbsp;&nbsp;&nbsp; <parameter key="sorting_direction" value="increasing"/><br>&nbsp; </operator><br></process><br><?xml version="1.0" encoding="UTF-8"?><process version="9.5.000"><br>&nbsp; <operator activated="true" class="store" compatibility="9.5.000" expanded="true" height="68" name="Store" width="90" x="715" y="187"><br>&nbsp;&nbsp;&nbsp; <parameter key="repository_entry" value="../../data/prei_vorwoche/A1"/><br>&nbsp; </operator><br></process><br><br></div>

lionelderkrikor

Hi @MPB_,

"I would like to loop thorugh a filter in a way that for every attribute of the column "UPC" (=Universal Product Code) a new exampleset is stored."
Your request is not clear :

You mean every value of the column "UPC" ? 
Moreover you XML process is broken, I can not import it in RapidMiner. Can you please export your process via File -> Export Process
and share the file here in the community ?
Can you also share your data  ?

Regards,

Lionel