Parallel execution of subprocesses

HeikoPaulheim
HeikoPaulheim New Altair Community Member
edited November 2024 in Community Q&A
Hi RapidMiners,

I have written an operator that executes a subprocess with different subsets of the data (like Bagging does, just a bit trickier, since the metadata also changes between the runs - but I eventually got it to work).

Now, my question is: can I execute multiple instances of the subprocess in parallel? If yes, how do I do that? The problem is that there seems to be only one instance of the nested process and its ports, so if I try something like that

innerExampleSource.deliver(DATA_FOR_THIS_RUN);
getSubprocess(0).execute();
PredictionModel model = (PredictionModel) innerModelSink.getData(PredictionModel.class);
in a multithreaded fashion, it breaks.

Any hints and/or templates?

Thank you,
Heiko

Answers

  • HeikoPaulheim
    HeikoPaulheim New Altair Community Member
    Hi RapidMiners,

    I found a way around by calling "cloneOperator". However, I am not exactly sure what is happening here (despite the documentation of said method saying "Use this method only if you sure what you are doing."  ;)), so I still appreciate your feedback.

    Cheers,
    Heiko

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.