"Decision Tree and Feature selection results"
ammargh
New Altair Community Member
Using RM 5.3.008
Prediction done using Decision tree.
I have used feature selection (Optimize selection) with backward selection. The output of this process was used as an input for X-Validation block. A 90 % accuracy was achieved.
I have found that the feature selection process has removed one feature.
I have replaced the "Optimize selection" block by "select attribute" component and removed that feature. The X-Validation accuracy has dropped down to 89%.
Am I missing something? Shouldn't I get the same accuracy since all other parameters are the same?
Thank you in advanced for your reply
Prediction done using Decision tree.
I have used feature selection (Optimize selection) with backward selection. The output of this process was used as an input for X-Validation block. A 90 % accuracy was achieved.
I have found that the feature selection process has removed one feature.
I have replaced the "Optimize selection" block by "select attribute" component and removed that feature. The X-Validation accuracy has dropped down to 89%.
Am I missing something? Shouldn't I get the same accuracy since all other parameters are the same?
Thank you in advanced for your reply
Tagged:
0
Answers
-
Tried to reproduce what you have described, but I get the same accuracy. Could you post an example process with a small data set?0
-
I am sorry I could not get permission to provide my data.
I will try to generate similar data artificially
Thank you.0