Two different performance scores? (Deep Learning)

dubbhism
dubbhism New Altair Community Member
edited November 5 in Community Q&A

Hello everybody,

 

I'm strictly a newbie, and i've been experimenting for a while, mostly with the new Deep Learning module. So far so good, but recently i noticed that the (regression) performance module gives me performance-values that are not the same as the values given by H2O. I do remember that at an earlier moment, this was not the case, but i can't figure out what has changed. The H2O values seem more reliable Any ideas?

 

I've added an example of a process

Greetings,

Anton

Best Answer

  • MartinLiebig
    MartinLiebig
    Altair Employee
    Answer ✓

    Hi dubbhism,

     

    the performance measures in the description of DL are training errors, not real prediction errors. Thus they are different to your splitted data and also should be treated with care. We always recommend to use Cross validation.

     

    ~Martin

Answers

  • MartinLiebig
    MartinLiebig
    Altair Employee
    Answer ✓

    Hi dubbhism,

     

    the performance measures in the description of DL are training errors, not real prediction errors. Thus they are different to your splitted data and also should be treated with care. We always recommend to use Cross validation.

     

    ~Martin

  • dubbhism
    dubbhism New Altair Community Member

    Thanx a lot Martin!