🎉Community Raffle - Win $25

An exclusive raffle opportunity for active members like you! Complete your profile, answer questions and get your first accepted badge to enter the raffle.
Join and Win

Different algorithm for modeling and nested in GA for feature selection

User: "Iatii"
New Altair Community Member
Updated by Jocelyn

Find more posts tagged with

Sort by:
1 - 6 of 61

    Hi,

     

    can you maybe post your proess?

     

    ~Martin

    User: "Iatii"
    New Altair Community Member
    OP

    Sure

     

    image

     

    User: "Iatii"
    New Altair Community Member
    OP
    User: "Iatii"
    New Altair Community Member
    OP

    Dear lattii,

     

    to be honest your process looks a bit odd in general. You apply the k-nn on the learned data in the GA, which leads to overtraining. Further you used a split validation by hand w/o taking the Ga into account, this is again something which yields to overtraining. I would suggest to put a cross validation around everything. It is further a bit strange to use a naive bayes to generate features and a k-NN for classification - but if it works, it works.

     

    ~Martin

    User: "Iatii"
    New Altair Community Member
    OP
    thanks for your guidance,

    Do you think if I delete the whole K-NN process in GA and then bring the modeling process in GA (delete the splitting operator and using split validation), it work true ?

    and about the model discussed, you are saying if my model works, so it is true. In this case the feature selection is done using K-NN or NB ? I get a little confused. I am new user to RM, so sorry for these questions.