My honest testing performance is greater than training performance? is it luck or incorrect

Tsar1131
Tsar1131 New Altair Community Member
edited November 2024 in Community Q&A
I have used split operator on my data source in the ratio of 4:1 for training and honest testing I am using DT and cross-validation.
The performance result for testing is accuracy 93.21%, kappa 0.863 and for training accuracy 93.97%, kappa 0.695 
I need to know whether the model is underfitting data and how should I conclude this result 

Welcome!

It looks like you're new here. Sign in or register to get started.

Best Answer

Answers

  • MartinLiebig
    MartinLiebig
    Altair Employee
    Hi,
    I would use a cross validation to check for the std_dev of the performance. Then you can see how lucky you are.

    Best,
    Martin
  • Tsar1131
    Tsar1131 New Altair Community Member
    hi @mschmitz
    it say +/- 0.31%
  • Tsar1131
    Tsar1131 New Altair Community Member
    edited August 2020
    Thanks @mschmitz
    can you comment on the value of kappa that my model is producing. I'm curious to know why it is high for honest testing compared to training. 
    Thanks again
  • MartinLiebig
    MartinLiebig
    Altair Employee
    I would do the same trick there :)
    But generally, if testing is better than training its rather unproblematic

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.