Permutation Validity

B_Miner
B_Miner New Altair Community Member
edited November 5 in Community Q&A
Hi All -

Is there anyway in RM to run permutation of the label value amongst the training records? I am looking at this method (performed many times) as a form of model validation and to generate a p-value. Any RM or general thoughts on this practice?

Thanks!
Brian
Tagged:

Answers

  • land
    land New Altair Community Member
    Hi Brian,
    am I right if I assume, that you want to redistribute the label's values among the examples randomly?
    As far as I recall that is not possible in RapidMiner, but you might change the label values randomly instead of redistributing them. This might be achieved by the Add Noise operator.

    Greetings,
      Sebastian
  • B_Miner
    B_Miner New Altair Community Member
    Hey Sebastian-

    Yes, I am looking for a way to randomly assign labels to training cases (maintaining the number of each label of course)..
  • land
    land New Altair Community Member
    Hi,
    I think we don't have such a method currently. Uhm. I think you will have to use the Scripting operator or write an entire Extension to add this functionality. There's a white paper available in our shop, that describes in detail how to the Scripting operator works and how Extensions can be created.

    Greetings,
      Sebastian

Categories