How to evaluate the performance of supervised learning of auto model?

AP
AP New Altair Community Member
edited November 5 in Community Q&A
How to evaluate the performance of supervised learning of auto model?Is there any documentation about this?
Tagged:

Best Answer

  • Caperez
    Caperez Altair Community Member
    Answer ✓
    Hi @AP

    Into Automodel you have a button "Open Process" click on and then you can see the scoring, validation block.
    Inside you have the validation subprocess.

    Best, 

    Cesar

      

Answers

  • Caperez
    Caperez Altair Community Member
    Hi @AP,

    You have two ways.
    1- In each model used in Automode you have a specifif topic for performance with some performance meassurements.
    2- You can open the automodel process and then, into the performance opertator, change the automatically selected metrics for your desired ones.

    Best

    Cesar
  • AP
    AP New Altair Community Member
    What I want to know is Whether it's based on training set or test set
  • Caperez
    Caperez Altair Community Member
    Hi again @AP

    when you open the model, the performance operator is applied to validation set.

    Best.

    Cesar
  • AP
    AP New Altair Community Member
    The performance is based on cross validation?default ten fold?
  • Caperez
    Caperez Altair Community Member
    Hi @AP
    when you open the proposed model in automodel you can check the validation process. 

    As far I remember the system use to work with a Hold-out set but I don't remeber the number of partitions. 

    You can check it in your results. 
  • AP
    AP New Altair Community Member
    “when you open the proposed model in automodel you can check the validation process. ”--How can I do it?Can you give me a graph?
  • Caperez
    Caperez Altair Community Member
    Answer ✓
    Hi @AP

    Into Automodel you have a button "Open Process" click on and then you can see the scoring, validation block.
    Inside you have the validation subprocess.

    Best, 

    Cesar

      
  • AP
    AP New Altair Community Member
    Yes, I see. Thank you very much