Hi Ingo et al.
I would like to use RM's confusion matrix visualisation for to report my results using Weka classifiers (several of them trained on different arffs)
This works...:
<operator name="Root" class="Process" expanded="yes">
<description text="The performance criteria accuracy and classification_error produces a confusion matrix for both binary and multi classification tasks. This confusion matrix even holds the information for per-class performance."/>
<operator name="ArffExampleSource" class="ArffExampleSource">
<parameter key="data_file" value="C:\Users\HarriS\Desktop\datasets\runnables-CEO\datasets\27-fold-test-CSPZ.arff"/>
<parameter key="label_attribute" value="fold"/>
</operator>
<operator name="XValidation" class="XValidation" expanded="yes">
<operator name="NearestNeighbors" class="NearestNeighbors">
</operator>
<operator name="OperatorChain" class="OperatorChain" expanded="yes">
<operator name="ModelApplier" class="ModelApplier">
<list key="application_parameters">
</list>
</operator>
<operator name="ClassificationPerformance" class="ClassificationPerformance">
<parameter key="accuracy" value="true"/>
<list key="class_weights">
</list>
<parameter key="kappa" value="true"/>
</operator>
</operator>
</operator>
</operator>
...only with one classifier trained on one arff but while I'm sure multiple classifiers on multiple arffs can be done in RM (and would be obliged for any script revisions or sample scripts on how to nest them here)
But perhaps this might be quicker and more in line with my obtained results: can I somehow give RM a preprepared confusion matrix that ClassificationPerformance operator could accept, i.e. so that those nests of multiple classifier operators on multiple input sources wouldn't need to be run in RM because I'm not at all sure that the same EXACT results would emerge as they do with Weka 3.5.7 (can be wrong but running all of them again would require a lot of further work on my part).
If so, what would be the format of the cofusion matrix?
thanks, Harri S
