Logistic Regression - Model Training Error (H2) NullPointerException

rtbarber
rtbarber New Altair Community Member
edited November 5 in Community Q&A

I have a model with a binomial outcome variable.  I built it using a decision tree, but would like to try a few other model types.  Logistic Regression is the obvious next choice, but when I run it I get:  Model training error (H2O).  Error while training the H2O model java.lang.NullPointerException. Please check your input data and the parameter setup. 

 

The process is relatively simple - after selecting an even sample, I have an Optimize Selection (Evolutionary) node, within which is a Validation node, and within that is the Logistic Regression node.  The input data is a mix of numeric (integer, real, numeric) and polynomial data with no missing data. There are a LOT Of attributes (253) but only 1486 records.  The Optimize Selection is intended to prune that down.  (The decision tree used 4 of those variables.) 

 

Any insights as to what this error means or what is going wrong?  Is there a log file somewhere I need to be looking at?

Answers

  • Thomas_Ott
    Thomas_Ott New Altair Community Member

    Can you post the XML of the process?

  • IngoRM
    IngoRM New Altair Community Member

    And - if possible and not confidential - maybe even a sample of the data causing this error?  We can also figure out via private message if you prefer.  We changed the underlying behavior of the Logistic Regression model recently and despite our tests there might always some specifics about data we did not capture ourselves...

     

    Thanks,

    Ingo

  • rtbarber
    rtbarber New Altair Community Member

    Happy to help!  I am running 7.2 on a Mac (just installed this AM)  I've anonymized the data and can share it via PM (I have no problem with your team having access to it, but there is potentially an issue if it were to get out into the wild.)  In the meantime, a simplified XML is attached that reads the CSV of the data I will share (which is post ETL stuff).  No change in error, so it wasn't in any of that mess.

  • IngoRM
    IngoRM New Altair Community Member

    Perfect, thanks for your help on this.  We will keep the data confidential of course and will have a look into this.  Our engineers will keep you posted on the progress...

     

    Thanks again,

    Ingo

  • IngoRM
    IngoRM New Altair Community Member

    Hi again,

     

    I got your process running if I de-select "compute p-values".  So if you do not need them at this point this is at least a workaround until we publish a patch...

     

    Best,

    Ingo

  • rtbarber
    rtbarber New Altair Community Member

    Thanks Ingo - That worked as an interim solution while I am developing the model.  I look forward to the patch!

  • IngoRM
    IngoRM New Altair Community Member

    Hi,

     

    Just a quick update on this: we are working on this right now and will come back as soon as we know when we will release a patch.

     

    Best,

    Ingo

  • phellinger
    phellinger New Altair Community Member

    Hi,

     

    here is the update: Studio 7.3 release fixes this error.

     

    For earlier versions, the workaround is to disable "compute p-values".

    The fix in the release actually does something similar: disables the p-values computation when there are too many (like a couple thousand) distinct nominal values in one or more regular attributes. Having such regular attributes may actually indicate that some feature selection / engineering is required before the training, even if the algorithm can deal with an input like this. 

     

    Best,

    Peter

  • Shaila_Segal
    Shaila_Segal New Altair Community Member
    I am using RapidMiner 9.6.000 and I am having the same issue with the Model training error (H2O) with my logistic regression function.  I have tried the unchecking compute p-value and it hasn't fixed it.  Is there something else I can do in the newest version?
  • sgenzer
    sgenzer
    Altair Employee
    hi @Shaila_Segal this seems like a duplicate post?