Probabilities from LogisticRegression

evgeny
evgeny New Altair Community Member
edited November 5 in Community Q&A
Hi, I am trying to find a way of extracting probabilities out of a LogisticRegression model.

I found a post which talks about "converting" confidence values into probabilies using the PlattScaling operator.

However, I am finding that the confidence values which are produced following PlattScaling are not the logistic regression probabilies that I would expect (i.e. taking the callibration parameters for the logistic regression generated by RM (which are spot-on) and manually computing the probability as prob = exp / [1 + exp] ).

what am i doing wrong? and is there a way to extract the logit probabilities?

many thx.
Tagged:

Answers

  • land
    land New Altair Community Member
    Hi,
    I think this is because the PlattScaling uses another algorithm to determine the probabilities. But I'm not that familiar with this algorithm, that I could describe what's happening there...

    Greetings,
      Sebastian
  • evgeny
    evgeny New Altair Community Member
    thx, Sebastian.

    further to my original post: the LogLikelihood figure produced by RM is what i would expect if regression probabilities were p = exp / [1+exp ]

    which is not the case if one was to compute the LogLikelihood with produced Confidence values both before and after PlattScaling. (both of which result in poorer fit, in my particular case).
  • earmijo
    earmijo New Altair Community Member
    Evgeny:
    Try using the Weka's LogistRegression operator. It's faster and it will give you the probabilities you want (after ModelApplier).