Classifying as unknown if confidence is under a certain threshold

Ryujakk
Ryujakk New Altair Community Member
edited November 5 in Community Q&A
Hello there!

So here is my current problem: I'm doing a classification task and I would like examples to be marked as unknown ( '?' ) when the model's confidence is under a certain threshold. I tried using the ThresholdFinder operator, but it seems to only accept binominal exampleSets (whereas I have a polynominal one.) I also tried to include my LibSVMLearner in CostBasedThresholdLearner, which seems like the right track. However, I don't really understand how to configure the CostBasedThresholdLearner to suit my needs...
Am I on the right track here? If not, is there an operator I have not found yet which could work?

Thanks in advance for your help!

- R

Edit: I just found the UncertainPredictionsTransformation operator. You guys really though of everything  :)
Tagged:

Answers

  • land
    land New Altair Community Member
    Yes, we are using RapidMiner for predicting the needs of our customers :)

Categories