An exclusive raffle opportunity for active members like you! Complete your profile, answer questions and get your first accepted badge to enter the raffle.
Hi I'm new to Time Series ARIMA model. when I train this model with the data below. i got this error: Indices of the time series are not strictly monotonic increasing. I try to forcast energy usage for every 15 mins. please advise.
Time Usage
hello @xiangw02 welcome to the community! Some quick recommendations for you:• Post your XML process here in this thread (see https://youtu.be/KkgB5QXWXJ8 and "Read Before Posting" on right when you reply)• Attach your dataset if possible (use a fictionalized version if there are privacy concerns)• Make sure you have all necessary extensions installed (see https://youtu.be/pjBqG3xtXx4)Scott
<?xml version="1.0" encoding="UTF-8"?><process version="8.1.001"> <operator activated="true" class="timeseries:arima_trainer" compatibility="0.1.002" expanded="true" height="103" name="ARIMA Trainer" width="90" x="179" y="85"> <parameter key="time_series_attribute" value="kW"/> <parameter key="has_indices" value="true"/> <parameter key="indices_attribute" value="Period"/> <parameter key="plithiumorder_of_the_autoregressive_model" value="1"/> <parameter key="dlithiumdegree_of_differencing" value="0"/> <parameter key="qlithiumorder_of_the_moving-average_model" value="1"/> <parameter key="estimate_constant" value="true"/> </operator></process>
Hi @xiangw02
Can you verify your process, your XML is broken...
Regards,
Lionel
Hi again @xiangw02,
OK, I can visualize your data in RapidMiner,
I understandand you want to forecast Energy (kW) in the future.....
but can you be more precise (in the last day, week, month......??????)
next 24 hours but by every 15 mins interval.
any one can help this?
I'm working on a process for your project.
I will have an answer element tomorrow.
@lionelderkrikor, did you figure out a solution? thanks!
I'm not a specialist of ARIMA, but you can find here a process to forecast the Energy using
the kNN model (you can test different models - SVM, Neural Nets etc. - inside the Validation operator in order to find the best performance).
<?xml version="1.0" encoding="UTF-8"?><process version="8.1.001"> <context> <input/> <output/> <macros> <macro> <key>futureMonths</key> <value>15</value> </macro> <macro> <key>horizon</key> <value>1</value> </macro> <macro> <key>windowSize</key> <value>6</value> </macro> </macros> </context> <operator activated="true" class="process" compatibility="6.0.002" expanded="true" name="Process"> <process expanded="true"> <operator activated="true" class="read_csv" compatibility="8.1.001" expanded="true" height="68" name="Read CSV" width="90" x="45" y="136"> <parameter key="csv_file" value="C:\Users\Lionel\Documents\Formations_DataScience\Rapidminer\Tests_Rapidminer\Energy_forecast\Copy of HJD_Electricity_Interval_3.16-3.18 (002).csv"/> <parameter key="column_separators" value=","/> <parameter key="grouped_digits" value="true"/> <parameter key="date_format" value="MM/dd/yyyy"/> <parameter key="first_row_as_names" value="false"/> <list key="annotations"> <parameter key="0" value="Name"/> </list> <parameter key="encoding" value="windows-1252"/> <list key="data_set_meta_data_information"> <parameter key="0" value="Period.true.date_time.id"/> <parameter key="1" value="kW.true.polynominal.attribute"/> </list> </operator> <operator activated="true" class="sort" compatibility="8.1.001" expanded="true" height="82" name="Sort" width="90" x="179" y="136"> <parameter key="attribute_name" value="Period"/> </operator> <operator activated="true" class="rename" compatibility="8.1.001" expanded="true" height="82" name="Rename (2)" width="90" x="313" y="136"> <parameter key="old_name" value="Period"/> <parameter key="new_name" value="DateTime"/> <list key="rename_additional_attributes"/> </operator> <operator activated="true" class="subprocess" compatibility="8.1.001" expanded="true" height="82" name="Set Predictions_Params" width="90" x="447" y="136"> <process expanded="true"> <operator activated="true" class="set_macro" compatibility="8.1.001" expanded="true" height="82" name="Set Window_Size" width="90" x="45" y="34"> <parameter key="macro" value="WindowSize"/> <parameter key="value" value="40"/> </operator> <operator activated="true" class="set_macro" compatibility="8.1.001" expanded="true" height="82" name="Set Horizon" width="90" x="179" y="34"> <parameter key="macro" value="horizon"/> <parameter key="value" value="1"/> </operator> <operator activated="true" class="set_macro" compatibility="8.1.001" expanded="true" height="82" name="Set Future_Day" width="90" x="313" y="34"> <parameter key="macro" value="futureDay"/> <parameter key="value" value="96"/> </operator> <connect from_port="in 1" to_op="Set Window_Size" to_port="through 1"/> <connect from_op="Set Window_Size" from_port="through 1" to_op="Set Horizon" to_port="through 1"/> <connect from_op="Set Horizon" from_port="through 1" to_op="Set Future_Day" to_port="through 1"/> <connect from_op="Set Future_Day" from_port="through 1" to_port="out 1"/> <portSpacing port="source_in 1" spacing="0"/> <portSpacing port="source_in 2" spacing="0"/> <portSpacing port="sink_out 1" spacing="0"/> <portSpacing port="sink_out 2" spacing="0"/> </process> </operator> <operator activated="true" class="set_role" compatibility="5.3.013" expanded="true" height="82" name="Set Role" width="90" x="581" y="136"> <parameter key="attribute_name" value="DateTime"/> <parameter key="target_role" value="id"/> <list key="set_additional_roles"/> </operator> <operator activated="true" class="select_attributes" compatibility="8.1.001" expanded="true" height="82" name="Select Attributes" width="90" x="715" y="136"> <parameter key="attribute_filter_type" value="subset"/> <parameter key="attributes" value="kW"/> </operator> <operator activated="true" class="filter_examples" compatibility="6.4.000" expanded="true" height="103" name="Filter Examples" width="90" x="916" y="85"> <parameter key="condition_class" value="no_missing_attributes"/> <list key="filters_list"/> </operator> <operator activated="true" class="parse_numbers" compatibility="8.1.001" expanded="true" height="82" name="Parse Numbers" width="90" x="1050" y="136"> <parameter key="grouped_digits" value="true"/> </operator> <operator activated="true" class="series:windowing" compatibility="5.2.000" expanded="true" height="82" name="Windowing for Training" width="90" x="1184" y="136"> <parameter key="window_size" value="%{WindowSize}"/> <parameter key="create_label" value="true"/> <parameter key="label_attribute" value="kW"/> <parameter key="horizon" value="%{horizon}"/> </operator> <operator activated="true" class="series:sliding_window_validation" compatibility="7.4.000" expanded="true" height="124" name="Validation" width="90" x="1318" y="34"> <parameter key="training_window_width" value="40"/> <parameter key="test_window_width" value="20"/> <process expanded="true"> <operator activated="true" class="k_nn" compatibility="8.1.001" expanded="true" height="82" name="k-NN" width="90" x="179" y="34"/> <connect from_port="training" to_op="k-NN" to_port="training set"/> <connect from_op="k-NN" from_port="model" to_port="model"/> <portSpacing port="source_training" spacing="0"/> <portSpacing port="sink_model" spacing="0"/> <portSpacing port="sink_through 1" spacing="0"/> </process> <process expanded="true"> <operator activated="true" class="apply_model" compatibility="8.1.001" expanded="true" height="82" name="Apply Model (2)" width="90" x="112" y="34"> <list key="application_parameters"/> </operator> <operator activated="true" class="performance_regression" compatibility="8.1.001" expanded="true" height="82" name="Performance" width="90" x="246" y="34"/> <connect from_port="model" to_op="Apply Model (2)" to_port="model"/> <connect from_port="test set" to_op="Apply Model (2)" to_port="unlabelled data"/> <connect from_op="Apply Model (2)" from_port="labelled data" to_op="Performance" to_port="labelled data"/> <connect from_op="Performance" from_port="performance" to_port="averagable 1"/> <portSpacing port="source_model" spacing="0"/> <portSpacing port="source_test set" spacing="0"/> <portSpacing port="source_through 1" spacing="0"/> <portSpacing port="sink_averagable 1" spacing="0"/> <portSpacing port="sink_averagable 2" spacing="0"/> </process> </operator> <operator activated="true" class="series:windowing" compatibility="5.2.000" expanded="true" height="82" name="Windowing for Application" width="90" x="1318" y="187"> <parameter key="window_size" value="%{WindowSize}"/> <parameter key="label_attribute" value="inputYt"/> </operator> <operator activated="true" class="extract_macro" compatibility="8.1.001" expanded="true" height="68" name="Extract Example Count" width="90" x="1519" y="187"> <parameter key="macro" value="exampleCount"/> <list key="additional_macros"/> </operator> <operator activated="true" class="filter_example_range" compatibility="8.1.001" expanded="true" height="82" name="Filter Example Range" width="90" x="1653" y="187"> <parameter key="first_example" value="%{exampleCount}"/> <parameter key="last_example" value="%{exampleCount}"/> </operator> <operator activated="true" class="remember" compatibility="8.1.001" expanded="true" height="68" name="Remember" width="90" x="1787" y="187"> <parameter key="name" value="data"/> </operator> <operator activated="true" class="loop" compatibility="8.1.001" expanded="true" height="82" name="Loop" width="90" x="1519" y="34"> <parameter key="iterations" value="%{futureDay}"/> <process expanded="true"> <operator activated="true" class="recall" compatibility="8.1.001" expanded="true" height="68" name="Recall" width="90" x="45" y="136"> <parameter key="name" value="data"/> </operator> <operator activated="true" class="apply_model" compatibility="7.1.001" expanded="true" height="82" name="Apply Model" width="90" x="179" y="30"> <list key="application_parameters"/> </operator> <operator activated="true" class="multiply" compatibility="8.1.001" expanded="true" height="103" name="Multiply" width="90" x="447" y="30"/> <operator activated="true" class="materialize_data" compatibility="8.1.001" expanded="true" height="82" name="Materialize Data (2)" width="90" x="179" y="165"/> <operator activated="true" class="generate_attributes" compatibility="6.4.000" expanded="true" height="82" name="Increase Date (2)" width="90" x="313" y="165"> <list key="function_descriptions"> <parameter key="DateTime" value="date_add(DateTime, 15, DATE_UNIT_MINUTE)"/> </list> </operator> <operator activated="true" class="set_role" compatibility="5.3.013" expanded="true" height="82" name="Set Role (2)" width="90" x="447" y="165"> <parameter key="attribute_name" value="prediction(label)"/> <list key="set_additional_roles"/> </operator> <operator activated="true" class="select_attributes" compatibility="8.1.001" expanded="true" height="82" name="Select Attributes (3)" width="90" x="179" y="289"> <parameter key="attribute_filter_type" value="single"/> <parameter key="attribute" value="kW-39"/> <parameter key="invert_selection" value="true"/> </operator> <operator activated="true" class="rename" compatibility="8.1.001" expanded="true" height="82" name="Rename" width="90" x="313" y="289"> <parameter key="old_name" value="kW-38"/> <parameter key="new_name" value="kW-39"/> <list key="rename_additional_attributes"> <parameter key="kW-37" value="kW-38"/> <parameter key="kW-36" value="kW-37"/> <parameter key="kW-35" value="kW-36"/> <parameter key="kW-34" value="kW-35"/> <parameter key="kW-33" value="kW-34"/> <parameter key="kW-32" value="kW-33"/> <parameter key="kW-31" value="kW-32"/> <parameter key="kW-30" value="kW-31"/> <parameter key="kW-29" value="kW-30"/> <parameter key="kW-28" value="kW-29"/> <parameter key="kW-27" value="kW-28"/> <parameter key="kW-26" value="kW-27"/> <parameter key="kW-25" value="kW-26"/> <parameter key="kW-24" value="kW-25"/> <parameter key="kW-23" value="kW-24"/> <parameter key="kW-22" value="kW-23"/> <parameter key="kW-21" value="kW-22"/> <parameter key="kW-20" value="kW-21"/> <parameter key="kW-19" value="kW-20"/> <parameter key="kW-18" value="kW-19"/> <parameter key="kW-17" value="kW-18"/> <parameter key="kW-16" value="kW-17"/> <parameter key="kW-15" value="kW-16"/> <parameter key="kW-14" value="kW-15"/> <parameter key="kW-13" value="kW-14"/> <parameter key="kW-12" value="kW-13"/> <parameter key="kW-11" value="kW-12"/> <parameter key="kW-10" value="kW-11"/> <parameter key="kW-9" value="kW-10"/> <parameter key="kW-8" value="kW-9"/> <parameter key="kW-7" value="kW-8"/> <parameter key="kW-6" value="kW-7"/> <parameter key="kW-5" value="kW-6"/> <parameter key="kW-4" value="kW-5"/> <parameter key="kW-3" value="kW-4"/> <parameter key="kW-2" value="kW-3"/> <parameter key="kW-1" value="kW-2"/> <parameter key="kW-0" value="kW-1"/> <parameter key="prediction(label)" value="kW-0"/> </list> </operator> <operator activated="true" class="remember" compatibility="8.1.001" expanded="true" height="68" name="Remember (2)" width="90" x="447" y="289"> <parameter key="name" value="data"/> </operator> <connect from_port="input 1" to_op="Apply Model" to_port="model"/> <connect from_op="Recall" from_port="result" to_op="Apply Model" to_port="unlabelled data"/> <connect from_op="Apply Model" from_port="labelled data" to_op="Multiply" to_port="input"/> <connect from_op="Multiply" from_port="output 1" to_port="output 1"/> <connect from_op="Multiply" from_port="output 2" to_op="Materialize Data (2)" to_port="example set input"/> <connect from_op="Materialize Data (2)" from_port="example set output" to_op="Increase Date (2)" to_port="example set input"/> <connect from_op="Increase Date (2)" from_port="example set output" to_op="Set Role (2)" to_port="example set input"/> <connect from_op="Set Role (2)" from_port="example set output" to_op="Select Attributes (3)" to_port="example set input"/> <connect from_op="Select Attributes (3)" from_port="example set output" to_op="Rename" to_port="example set input"/> <connect from_op="Rename" from_port="example set output" to_op="Remember (2)" to_port="store"/> <portSpacing port="source_input 1" spacing="0"/> <portSpacing port="source_input 2" spacing="0"/> <portSpacing port="sink_output 1" spacing="0"/> <portSpacing port="sink_output 2" spacing="0"/> </process> </operator> <operator activated="true" class="append" compatibility="8.1.001" expanded="true" height="82" name="Append" width="90" x="1653" y="34"/> <connect from_op="Read CSV" from_port="output" to_op="Sort" to_port="example set input"/> <connect from_op="Sort" from_port="example set output" to_op="Rename (2)" to_port="example set input"/> <connect from_op="Rename (2)" from_port="example set output" to_op="Set Predictions_Params" to_port="in 1"/> <connect from_op="Set Predictions_Params" from_port="out 1" to_op="Set Role" to_port="example set input"/> <connect from_op="Set Role" from_port="example set output" to_op="Select Attributes" to_port="example set input"/> <connect from_op="Select Attributes" from_port="example set output" to_op="Filter Examples" to_port="example set input"/> <connect from_op="Filter Examples" from_port="example set output" to_op="Parse Numbers" to_port="example set input"/> <connect from_op="Parse Numbers" from_port="example set output" to_op="Windowing for Training" to_port="example set input"/> <connect from_op="Windowing for Training" from_port="example set output" to_op="Validation" to_port="training"/> <connect from_op="Windowing for Training" from_port="original" to_op="Windowing for Application" to_port="example set input"/> <connect from_op="Validation" from_port="model" to_op="Loop" to_port="input 1"/> <connect from_op="Validation" from_port="averagable 1" to_port="result 2"/> <connect from_op="Windowing for Application" from_port="example set output" to_op="Extract Example Count" to_port="example set"/> <connect from_op="Extract Example Count" from_port="example set" to_op="Filter Example Range" to_port="example set input"/> <connect from_op="Filter Example Range" from_port="example set output" to_op="Remember" to_port="store"/> <connect from_op="Loop" from_port="output 1" to_op="Append" to_port="example set 1"/> <connect from_op="Append" from_port="merged set" to_port="result 1"/> <portSpacing port="source_input 1" spacing="0"/> <portSpacing port="sink_result 1" spacing="0"/> <portSpacing port="sink_result 2" spacing="0"/> <portSpacing port="sink_result 3" spacing="0"/> </process> </operator></process>
I hope it helps,
Thanks. @lionelderkrikor. my data goes to 3/9/2018. the forcasting date is 3/18/2018. where do i set to 3/10/2018?
BTW can someone help debug my ARIMA process?
thanks
I think you have to preprocess your data, the time attribute (attribute Period) is not strictly increasing
and it generate a bug in the Arima trainer operator.
You have 2 times the same date-time in your dataset :
I hope it helps
@lionelderkrikor thanks again.
i reformat the date and Data Import wizard cannot format correct format. e.g. i attached the csv file for reference.
what's correct date-time format Data Import wizard can take?
This process work but i don't know why : the hours in the date_time attribute are not good displayed (always 12 : 00 :00 AM)
<?xml version="1.0" encoding="UTF-8"?><process version="8.1.001"> <context> <input/> <output/> <macros/> </context> <operator activated="true" class="process" compatibility="8.1.001" expanded="true" name="Process"> <process expanded="true"> <operator activated="true" class="read_csv" compatibility="8.1.001" expanded="true" height="68" name="Read CSV" width="90" x="112" y="85"> <parameter key="csv_file" value="C:\Users\Lionel\Documents\Formations_DataScience\Rapidminer\Tests_Rapidminer\Energy_forecast\Copy of HJD_Electricity_Interval_3.16-3.18 (002) (1).csv"/> <parameter key="column_separators" value=","/> <parameter key="grouped_digits" value="true"/> <parameter key="date_format" value="MM/dd/yyyy"/> <parameter key="first_row_as_names" value="false"/> <list key="annotations"> <parameter key="0" value="Name"/> </list> <parameter key="encoding" value="windows-1252"/> <list key="data_set_meta_data_information"> <parameter key="0" value="Period.true.date.attribute"/> <parameter key="1" value="kW.true.real.attribute"/> </list> </operator> <operator activated="false" class="nominal_to_date" compatibility="8.1.001" expanded="true" height="82" name="Nominal to Date" width="90" x="313" y="238"> <parameter key="attribute_name" value="Period"/> <parameter key="date_type" value="date_time"/> <parameter key="date_format" value="MM/dd/yyyy"/> </operator> <operator activated="false" class="parse_numbers" compatibility="8.1.001" expanded="true" height="82" name="Parse Numbers" width="90" x="447" y="238"> <parameter key="grouped_digits" value="true"/> </operator> <operator activated="true" class="timeseries:arima_trainer" compatibility="0.1.002" expanded="true" height="103" name="ARIMA Trainer" width="90" x="581" y="85"> <parameter key="time_series_attribute" value="kW"/> <parameter key="has_indices" value="true"/> <parameter key="indices_attribute" value="Period"/> </operator> <operator activated="true" class="timeseries:apply_forecast" compatibility="0.1.002" expanded="true" height="82" name="Apply Forecast" width="90" x="715" y="85"/> <connect from_op="Read CSV" from_port="output" to_op="ARIMA Trainer" to_port="example set"/> <connect from_op="ARIMA Trainer" from_port="forecast model" to_op="Apply Forecast" to_port="forecast model"/> <connect from_op="Apply Forecast" from_port="example set" to_port="result 1"/> <portSpacing port="source_input 1" spacing="0"/> <portSpacing port="sink_result 1" spacing="0"/> <portSpacing port="sink_result 2" spacing="0"/> </process> </operator></process>
@lionelderkrikor, can you look at the solution you provided?
my data goes to 3/9/2018. the forcasting date is 3/18/2018. where do i set to 3/10/2018?
Hi @xiangw02,
In deed, this is a strange behaviour.
I will study that and will give you an answer element, i hope, soon .
I applied a "fix" to set the prediction to 3/10/2018.
Here the new process :
<?xml version="1.0" encoding="UTF-8"?><process version="8.1.001"> <context> <input/> <output/> <macros> <macro> <key>futureMonths</key> <value>15</value> </macro> <macro> <key>horizon</key> <value>1</value> </macro> <macro> <key>windowSize</key> <value>6</value> </macro> </macros> </context> <operator activated="true" class="process" compatibility="6.0.002" expanded="true" name="Process"> <process expanded="true"> <operator activated="true" class="read_csv" compatibility="8.1.001" expanded="true" height="68" name="Read CSV" width="90" x="45" y="136"> <parameter key="csv_file" value="C:\Users\Lionel\Documents\Formations_DataScience\Rapidminer\Tests_Rapidminer\Energy_forecast\Copy of HJD_Electricity_Interval_3.16-3.18 (002).csv"/> <parameter key="column_separators" value=","/> <parameter key="grouped_digits" value="true"/> <parameter key="date_format" value="MM/dd/yyyy h:mm a"/> <parameter key="first_row_as_names" value="false"/> <list key="annotations"> <parameter key="0" value="Name"/> </list> <parameter key="encoding" value="windows-1252"/> <list key="data_set_meta_data_information"> <parameter key="0" value="Period.true.date_time.id"/> <parameter key="1" value="kW.true.polynominal.attribute"/> </list> </operator> <operator activated="true" class="sort" compatibility="8.1.001" expanded="true" height="82" name="Sort" width="90" x="179" y="136"> <parameter key="attribute_name" value="Period"/> </operator> <operator activated="true" class="rename" compatibility="8.1.001" expanded="true" height="82" name="Rename (2)" width="90" x="313" y="136"> <parameter key="old_name" value="Period"/> <parameter key="new_name" value="DateTime"/> <list key="rename_additional_attributes"/> </operator> <operator activated="true" class="subprocess" compatibility="8.1.001" expanded="true" height="82" name="Set Predictions_Params" width="90" x="447" y="136"> <process expanded="true"> <operator activated="true" class="set_macro" compatibility="8.1.001" expanded="true" height="82" name="Set Window_Size" width="90" x="45" y="34"> <parameter key="macro" value="WindowSize"/> <parameter key="value" value="40"/> </operator> <operator activated="true" class="set_macro" compatibility="8.1.001" expanded="true" height="82" name="Set Horizon" width="90" x="179" y="34"> <parameter key="macro" value="horizon"/> <parameter key="value" value="1"/> </operator> <operator activated="true" class="set_macro" compatibility="8.1.001" expanded="true" height="82" name="Set Future_Day" width="90" x="313" y="34"> <parameter key="macro" value="futureDay"/> <parameter key="value" value="96"/> </operator> <connect from_port="in 1" to_op="Set Window_Size" to_port="through 1"/> <connect from_op="Set Window_Size" from_port="through 1" to_op="Set Horizon" to_port="through 1"/> <connect from_op="Set Horizon" from_port="through 1" to_op="Set Future_Day" to_port="through 1"/> <connect from_op="Set Future_Day" from_port="through 1" to_port="out 1"/> <portSpacing port="source_in 1" spacing="0"/> <portSpacing port="source_in 2" spacing="0"/> <portSpacing port="sink_out 1" spacing="0"/> <portSpacing port="sink_out 2" spacing="0"/> </process> </operator> <operator activated="true" class="set_role" compatibility="5.3.013" expanded="true" height="82" name="Set Role" width="90" x="581" y="136"> <parameter key="attribute_name" value="DateTime"/> <parameter key="target_role" value="id"/> <list key="set_additional_roles"/> </operator> <operator activated="true" class="select_attributes" compatibility="8.1.001" expanded="true" height="82" name="Select Attributes" width="90" x="715" y="136"> <parameter key="attribute_filter_type" value="subset"/> <parameter key="attributes" value="kW"/> </operator> <operator activated="true" class="filter_examples" compatibility="6.4.000" expanded="true" height="103" name="Filter Examples" width="90" x="916" y="85"> <parameter key="condition_class" value="no_missing_attributes"/> <list key="filters_list"/> </operator> <operator activated="true" class="parse_numbers" compatibility="8.1.001" expanded="true" height="82" name="Parse Numbers" width="90" x="1050" y="136"> <parameter key="grouped_digits" value="true"/> </operator> <operator activated="true" class="series:windowing" compatibility="5.2.000" expanded="true" height="82" name="Windowing for Training" width="90" x="1184" y="136"> <parameter key="window_size" value="%{WindowSize}"/> <parameter key="create_label" value="true"/> <parameter key="label_attribute" value="kW"/> <parameter key="horizon" value="%{horizon}"/> </operator> <operator activated="true" class="series:sliding_window_validation" compatibility="7.4.000" expanded="true" height="124" name="Validation" width="90" x="1318" y="34"> <parameter key="training_window_width" value="40"/> <parameter key="test_window_width" value="20"/> <process expanded="true"> <operator activated="true" class="k_nn" compatibility="8.1.001" expanded="true" height="82" name="k-NN" width="90" x="179" y="34"/> <connect from_port="training" to_op="k-NN" to_port="training set"/> <connect from_op="k-NN" from_port="model" to_port="model"/> <portSpacing port="source_training" spacing="0"/> <portSpacing port="sink_model" spacing="0"/> <portSpacing port="sink_through 1" spacing="0"/> </process> <process expanded="true"> <operator activated="true" class="apply_model" compatibility="8.1.001" expanded="true" height="82" name="Apply Model (2)" width="90" x="112" y="34"> <list key="application_parameters"/> </operator> <operator activated="true" class="performance_regression" compatibility="8.1.001" expanded="true" height="82" name="Performance" width="90" x="246" y="34"/> <connect from_port="model" to_op="Apply Model (2)" to_port="model"/> <connect from_port="test set" to_op="Apply Model (2)" to_port="unlabelled data"/> <connect from_op="Apply Model (2)" from_port="labelled data" to_op="Performance" to_port="labelled data"/> <connect from_op="Performance" from_port="performance" to_port="averagable 1"/> <portSpacing port="source_model" spacing="0"/> <portSpacing port="source_test set" spacing="0"/> <portSpacing port="source_through 1" spacing="0"/> <portSpacing port="sink_averagable 1" spacing="0"/> <portSpacing port="sink_averagable 2" spacing="0"/> </process> </operator> <operator activated="true" class="series:windowing" compatibility="5.2.000" expanded="true" height="82" name="Windowing for Application" width="90" x="1318" y="187"> <parameter key="window_size" value="%{WindowSize}"/> <parameter key="label_attribute" value="inputYt"/> </operator> <operator activated="true" class="extract_macro" compatibility="8.1.001" expanded="true" height="68" name="Extract Example Count" width="90" x="1519" y="187"> <parameter key="macro" value="exampleCount"/> <list key="additional_macros"/> </operator> <operator activated="true" class="filter_example_range" compatibility="8.1.001" expanded="true" height="82" name="Filter Example Range" width="90" x="1653" y="187"> <parameter key="first_example" value="%{exampleCount}"/> <parameter key="last_example" value="%{exampleCount}"/> </operator> <operator activated="true" class="remember" compatibility="8.1.001" expanded="true" height="68" name="Remember" width="90" x="1787" y="187"> <parameter key="name" value="data"/> </operator> <operator activated="true" class="loop" compatibility="8.1.001" expanded="true" height="82" name="Loop" width="90" x="1452" y="34"> <parameter key="iterations" value="%{futureDay}"/> <process expanded="true"> <operator activated="true" class="recall" compatibility="8.1.001" expanded="true" height="68" name="Recall" width="90" x="45" y="136"> <parameter key="name" value="data"/> </operator> <operator activated="true" class="apply_model" compatibility="7.1.001" expanded="true" height="82" name="Apply Model" width="90" x="179" y="30"> <list key="application_parameters"/> </operator> <operator activated="true" class="multiply" compatibility="8.1.001" expanded="true" height="103" name="Multiply" width="90" x="447" y="30"/> <operator activated="true" class="materialize_data" compatibility="8.1.001" expanded="true" height="82" name="Materialize Data (2)" width="90" x="179" y="165"/> <operator activated="true" class="generate_attributes" compatibility="6.4.000" expanded="true" height="82" name="Increase Date (2)" width="90" x="313" y="165"> <list key="function_descriptions"> <parameter key="DateTime" value="date_add(DateTime, 15, DATE_UNIT_MINUTE)"/> </list> </operator> <operator activated="true" class="set_role" compatibility="5.3.013" expanded="true" height="82" name="Set Role (2)" width="90" x="447" y="165"> <parameter key="attribute_name" value="prediction(label)"/> <list key="set_additional_roles"/> </operator> <operator activated="true" class="select_attributes" compatibility="8.1.001" expanded="true" height="82" name="Select Attributes (3)" width="90" x="179" y="289"> <parameter key="attribute_filter_type" value="single"/> <parameter key="attribute" value="kW-39"/> <parameter key="invert_selection" value="true"/> </operator> <operator activated="true" class="rename" compatibility="8.1.001" expanded="true" height="82" name="Rename" width="90" x="313" y="289"> <parameter key="old_name" value="kW-38"/> <parameter key="new_name" value="kW-39"/> <list key="rename_additional_attributes"> <parameter key="kW-37" value="kW-38"/> <parameter key="kW-36" value="kW-37"/> <parameter key="kW-35" value="kW-36"/> <parameter key="kW-34" value="kW-35"/> <parameter key="kW-33" value="kW-34"/> <parameter key="kW-32" value="kW-33"/> <parameter key="kW-31" value="kW-32"/> <parameter key="kW-30" value="kW-31"/> <parameter key="kW-29" value="kW-30"/> <parameter key="kW-28" value="kW-29"/> <parameter key="kW-27" value="kW-28"/> <parameter key="kW-26" value="kW-27"/> <parameter key="kW-25" value="kW-26"/> <parameter key="kW-24" value="kW-25"/> <parameter key="kW-23" value="kW-24"/> <parameter key="kW-22" value="kW-23"/> <parameter key="kW-21" value="kW-22"/> <parameter key="kW-20" value="kW-21"/> <parameter key="kW-19" value="kW-20"/> <parameter key="kW-18" value="kW-19"/> <parameter key="kW-17" value="kW-18"/> <parameter key="kW-16" value="kW-17"/> <parameter key="kW-15" value="kW-16"/> <parameter key="kW-14" value="kW-15"/> <parameter key="kW-13" value="kW-14"/> <parameter key="kW-12" value="kW-13"/> <parameter key="kW-11" value="kW-12"/> <parameter key="kW-10" value="kW-11"/> <parameter key="kW-9" value="kW-10"/> <parameter key="kW-8" value="kW-9"/> <parameter key="kW-7" value="kW-8"/> <parameter key="kW-6" value="kW-7"/> <parameter key="kW-5" value="kW-6"/> <parameter key="kW-4" value="kW-5"/> <parameter key="kW-3" value="kW-4"/> <parameter key="kW-2" value="kW-3"/> <parameter key="kW-1" value="kW-2"/> <parameter key="kW-0" value="kW-1"/> <parameter key="prediction(label)" value="kW-0"/> </list> </operator> <operator activated="true" class="remember" compatibility="8.1.001" expanded="true" height="68" name="Remember (2)" width="90" x="447" y="289"> <parameter key="name" value="data"/> </operator> <connect from_port="input 1" to_op="Apply Model" to_port="model"/> <connect from_op="Recall" from_port="result" to_op="Apply Model" to_port="unlabelled data"/> <connect from_op="Apply Model" from_port="labelled data" to_op="Multiply" to_port="input"/> <connect from_op="Multiply" from_port="output 1" to_port="output 1"/> <connect from_op="Multiply" from_port="output 2" to_op="Materialize Data (2)" to_port="example set input"/> <connect from_op="Materialize Data (2)" from_port="example set output" to_op="Increase Date (2)" to_port="example set input"/> <connect from_op="Increase Date (2)" from_port="example set output" to_op="Set Role (2)" to_port="example set input"/> <connect from_op="Set Role (2)" from_port="example set output" to_op="Select Attributes (3)" to_port="example set input"/> <connect from_op="Select Attributes (3)" from_port="example set output" to_op="Rename" to_port="example set input"/> <connect from_op="Rename" from_port="example set output" to_op="Remember (2)" to_port="store"/> <portSpacing port="source_input 1" spacing="0"/> <portSpacing port="source_input 2" spacing="0"/> <portSpacing port="sink_output 1" spacing="0"/> <portSpacing port="sink_output 2" spacing="0"/> </process> </operator> <operator activated="true" class="append" compatibility="8.1.001" expanded="true" height="82" name="Append" width="90" x="1586" y="34"/> <operator activated="true" class="generate_attributes" compatibility="6.4.000" expanded="true" height="82" name="Correct Date (3)" width="90" x="1720" y="34"> <list key="function_descriptions"> <parameter key="DateTime" value="date_add(DateTime, -8, DATE_UNIT_DAY)"/> </list> </operator> <connect from_op="Read CSV" from_port="output" to_op="Sort" to_port="example set input"/> <connect from_op="Sort" from_port="example set output" to_op="Rename (2)" to_port="example set input"/> <connect from_op="Rename (2)" from_port="example set output" to_op="Set Predictions_Params" to_port="in 1"/> <connect from_op="Set Predictions_Params" from_port="out 1" to_op="Set Role" to_port="example set input"/> <connect from_op="Set Role" from_port="example set output" to_op="Select Attributes" to_port="example set input"/> <connect from_op="Select Attributes" from_port="example set output" to_op="Filter Examples" to_port="example set input"/> <connect from_op="Filter Examples" from_port="example set output" to_op="Parse Numbers" to_port="example set input"/> <connect from_op="Parse Numbers" from_port="example set output" to_op="Windowing for Training" to_port="example set input"/> <connect from_op="Windowing for Training" from_port="example set output" to_op="Validation" to_port="training"/> <connect from_op="Windowing for Training" from_port="original" to_op="Windowing for Application" to_port="example set input"/> <connect from_op="Validation" from_port="model" to_op="Loop" to_port="input 1"/> <connect from_op="Validation" from_port="averagable 1" to_port="result 1"/> <connect from_op="Windowing for Application" from_port="example set output" to_op="Extract Example Count" to_port="example set"/> <connect from_op="Extract Example Count" from_port="example set" to_op="Filter Example Range" to_port="example set input"/> <connect from_op="Filter Example Range" from_port="example set output" to_op="Remember" to_port="store"/> <connect from_op="Loop" from_port="output 1" to_op="Append" to_port="example set 1"/> <connect from_op="Append" from_port="merged set" to_op="Correct Date (3)" to_port="example set input"/> <connect from_op="Correct Date (3)" from_port="example set output" to_port="result 2"/> <portSpacing port="source_input 1" spacing="0"/> <portSpacing port="sink_result 1" spacing="0"/> <portSpacing port="sink_result 2" spacing="0"/> <portSpacing port="sink_result 3" spacing="0"/> </process> </operator></process>
