Find more posts tagged with
Sort by:
1 - 6 of
61
I have the actual + the predicted classes. I need to evaluate the performance of the clustering algorithm (external evaluation with confusion matrix, precision, recall, f-measure ...)
I am not sure the PERFORMANCE (CLASSIFICATION) could solve my issue (although some of its outputs are "weighted mean recall" and "weighted mean precision". This process as I think is for bi-classes.
How can I measure the clustering performance for multiclasses by the external validity indexes?
I am not sure the PERFORMANCE (CLASSIFICATION) could solve my issue (although some of its outputs are "weighted mean recall" and "weighted mean precision". This process as I think is for bi-classes.
How can I measure the clustering performance for multiclasses by the external validity indexes?
Clustering is of course unsupervised, so it isn't built in order to predict a specific label. Having said that, this subsequent question is not uncommon so RapidMiner includes an operator that allows you to do this, called "Map Clustering on Labels". It is designed for this purpose but you'll need to have the same number of clusters as you have classes you are trying to predict. Take a look at at the sample process for more help.
Hi @SamiRami
I'd add one concern here, technically you can actually use PERFORMANCE (CLASSIFICATION) operator on an arbitrary dataset, you only need to be sure that there's an attribute of type 'label', which indicates actual class, and another attribute of type 'prediction', which indicates model predicted class. If you already have a dataset representing this, you can use SET ROLE operator to define label and prediction columns respectively.
I'd add one concern here, technically you can actually use PERFORMANCE (CLASSIFICATION) operator on an arbitrary dataset, you only need to be sure that there's an attribute of type 'label', which indicates actual class, and another attribute of type 'prediction', which indicates model predicted class. If you already have a dataset representing this, you can use SET ROLE operator to define label and prediction columns respectively.
Hi @SamiRami
It could be easier to help you if you could share here actual dataset on which you want to produce confusion matrix and evaluate performance metrics.
It could be easier to help you if you could share here actual dataset on which you want to produce confusion matrix and evaluate performance metrics.
Confusion matrix is not actually applicable to clustering, since its purpose to show difference between model predictions and actual value of target variable in supervised classification algorithms, while clustering is an unsupervised algorithm by its nature.
However, if you have data labelled with actual classes (or clusters) plus predicted class value (cluster value produced by a model), you can use PERFORMANCE (CLASSIFICATION) operator to generate confusion matrix.