Altair RISE
A program to recognize and reward our most engaged community members
Nominate Yourself Now!
Home
Discussions
Community Q&A
Cannot genereate ROC from HBOS example set
MaartenK
Hello,
I have a model using HBOS to calculate an outlier score. I want to feed that into an "GenerateROC" component to evauluate the scores, like with other outlier detection components.
However, the GenerateROC component gives an design time error that the exampleset coming from the HBOS in facts is not an example set. I use the output connector at the top, without the colors.
I also tried saving the example set first and the feed it in the GenerateROC component in a new process.
In that case, the GenerateROC does give a run time error saying "' '' not found in the labels".
There seems to be something wrong with the metadata of the HBOS output example set. Any help with be great.
Kind regards,
Maarten
Find more posts tagged with
AI Studio
AUC ROC
Anomaly Detection
Accepted answers
Telcontar120
There is indeed a known problem with the metadata from the HBOS operator. Unfortunately it is a third party extension so RapidMiner has no direct control over that.
Having said that, you can get it to work. Simply use the Store operator after the HBOS operator, and then Retrieve the exampleset and it will have the appropriate metadata. However, to generate an ROC curve, you will need to do some additional work. You will need to use the HBOS score to generate a prediction and a confidence, set those roles accordingly, and then you will also need to set a label by creating an outlier/non-outlier flag (manually or with some other logic).
All comments
Telcontar120
There is indeed a known problem with the metadata from the HBOS operator. Unfortunately it is a third party extension so RapidMiner has no direct control over that.
Having said that, you can get it to work. Simply use the Store operator after the HBOS operator, and then Retrieve the exampleset and it will have the appropriate metadata. However, to generate an ROC curve, you will need to do some additional work. You will need to use the HBOS score to generate a prediction and a confidence, set those roles accordingly, and then you will also need to set a label by creating an outlier/non-outlier flag (manually or with some other logic).
Quick Links
All Categories
Recent Discussions
Activity
Unanswered
日本語 (Japanese)
한국어(Korean)
Groups