"ROC confidence limits"

brianbaker
brianbaker New Altair Community Member
edited November 5 in Community Q&A
Does anyone know how to control (toggle on/off) the confidence bands in the ROC curves?

I've copied code that has them into another process and they disappear!!

thanks!
Tagged:

Answers

  • land
    land New Altair Community Member
    Hi,
    perhaps you don't have confidence attributes in your data?

    Greetings,
      Sebastian
  • brianbaker
    brianbaker New Altair Community Member
    Sebastian,

    Thank you for your help!  I checked for that; they are there (in the performance export file).


    <com.rapidminer.tools.math.ROCPoint id="246">
                    <falsePositives>139.0</falsePositives>
                    <truePositives>68.0</truePositives>
                    <confidence>0.19407850064775464</confidence>
    </com.rapidminer.tools.math.ROCPoint>
     

    But, I can't figure out how to turn on the confidence band in the ROC plot.  I'd also like to know exactly what it represents; how, for instance, does it relate to the confidence value in the performance export file, is it the height of the shaded region?  I'd also like to know where this confidence comes from / how computed?


    If you have any answers or can point me in the right direction I'd appreciate it!

    Thanks!
    brian
  • steffen
    steffen New Altair Community Member
    I think the question has been answered here:
    http://rapid-i.com/rapidforum/index.php/topic,47.0.html
  • land
    land New Altair Community Member
    Thank you Steffen,
    this saved me a lot of either work or inconvenience by pointing Brian on the source code  :)

    Greetings,
      Sebastian
  • brianbaker
    brianbaker New Altair Community Member
    Thanks to you both Sebastian and Steffen!