Altair RISE

A program to recognize and reward our most engaged community members

Nominate Yourself Now!

How to evaluate the performance of supervised learning of auto model？

How to evaluate the performance of supervised learning of auto model？Is there any documentation about this？

Find more posts tagged with

AI Studio

Accepted answers

Caperez

Hi @AP,

Into Automodel you have a button "Open Process" click on and then you can see the scoring, validation block.
Inside you have the validation subprocess.

Best,

Cesar

Image: https://us.v-cdn.net/6030995/uploads/editor/9t/dnytexj8smj0.png

All comments

Caperez

Hi @AP,

You have two ways.
1- In each model used in Automode you have a specifif topic for performance with some performance meassurements.
2- You can open the automodel process and then, into the performance opertator, change the automatically selected metrics for your desired ones.

Best

Cesar

What I want to know is Whether it's based on training set or test set

Caperez

Hi again @AP,

when you open the model, the performance operator is applied to validation set.

Best.

Cesar

The performance is based on cross validation？default ten fold？

Caperez

Hi @AP,

when you open the proposed model in automodel you can check the validation process.

As far I remember the system use to work with a Hold-out set but I don't remeber the number of partitions.

You can check it in your results.

“when you open the proposed model in automodel you can check the validation process. ”--How can I do it？Can you give me a graph？

Caperez

Hi @AP,

Into Automodel you have a button "Open Process" click on and then you can see the scoring, validation block.
Inside you have the validation subprocess.

Best,

Cesar

Yes, I see. Thank you very much