"Compare model performance graphs"

dupolas

Hi there,

I was wondering if it is possible to run multiple classification models on the same dataset and compare the different performance curves.

For example I run a decision tree, neural net and logistic regression on a training and test set and would like to compare training and test performance.(eg. sq. avg error)

is this possible with Rapidminer?  I know it is with SAS and it is pretty usefull for me

Thanks a lot...

I googled for this and could not see any tutorials/posts on it..

Regards,

Geoffrey

MariusHelf

Hi,

I suppose you already know how to evaluate a single model in RapidMiner, e.g. with the X-Validation. The X-Validation puts out a performance vector, which should contain the root mean squared error. This value is only a scalar value, so I don't know from which data you want to create curves. Of course you can compare the values from different models, and if you extract the performance values, you also can write them into a single example set for easier comparison.

For classification problems we can create ROC comparison charts.

For the performance curves, please give us a more detailed description of what you want to do. Please read the post linked in my signature on how to write good questions.

Happy Mining!
~Marius