performance cost
hi all,
1. when I use classifier performance ( cost) operator, im not able to get confusion matrix in the results. Is there anyway to get both cost as well as conf matrix.
2. Im getting cost as 1.774. what does it mean really. can we derive this value in terms of currency like dollars/rupees.
3. Also would like to know use of meta cost operator and how does it
differ from normal cost operator
regds
thiru
1. when I use classifier performance ( cost) operator, im not able to get confusion matrix in the results. Is there anyway to get both cost as well as conf matrix.
2. Im getting cost as 1.774. what does it mean really. can we derive this value in terms of currency like dollars/rupees.
3. Also would like to know use of meta cost operator and how does it
differ from normal cost operator
regds
thiru
Find more posts tagged with
Sort by:
1 - 2 of
21
hi @ martin - thanks for your suggestions and it works. I just wanted to further calrify,
a. what I understand, the default is the base reference for comparisons with new faults and work out the misclassification costs. first of all how this default model is chosen ?
b. How to compare two or more classifiers - in a single process flow.
( I would like to compare two or more classifiers to arrive the misclassification cost in the single process)"
thanks
thiru
a. what I understand, the default is the base reference for comparisons with new faults and work out the misclassification costs. first of all how this default model is chosen ?
b. How to compare two or more classifiers - in a single process flow.
( I would like to compare two or more classifiers to arrive the misclassification cost in the single process)"
thanks
thiru
you can use both, Performance (Classification) and Performance (Cost). The former one has a input for another Performance vector to create one big one.
2. The average cost per example is 1.774. I recommend to compare this to a cost of a default model (Default model operator), which could be you predict all to be Loyal or something.
3. Check: https://dl.acm.org/doi/10.1145/312129.312220 which is the paper for it. It's not too crazy. You use a bagged ensemble to get a better estimate of confidence. This is actually not much like the Performance cost, but more like the Cost Sensitive Scoring operator we use in AutoModel.
Cheers,
Martin