🎉Community Raffle - Win $25

An exclusive raffle opportunity for active members like you! Complete your profile, answer questions and get your first accepted badge to enter the raffle.
Join and Win

Random forest basic question

User: "Fred12"
Fred12
New Altair Community Member
Updated by Jocelyn

hi,

I a paper about general algorithm of random forest, it is said on each node, a subset of variables is chosen to test.

my Question: When its constructing the tree with the training set, will there already be made the choice of random variables to built the tree? or will it be trained with all variables, and afterwards, for testing only a small subset of variables will be chosen to test the tree on OOB data?

 

and finally, do the subsets  always have to be nonoverlapping, means distinct from eachother? or is it entirely randomly how to choose variables? so that there can also be repeated variables  (more than one of the same) to test each node?

Find more posts tagged with

AI Studio
Sort by:
1 - 2 of 21
    User: "Fred12"
    Fred12
    New Altair Community Member
    OP

    has anyone an idea?

    User: "IngoRM"
    IngoRM
    New Altair Community Member
    Accepted Answer

    Hi,

     

    The random subsets are chosen during the training phase already.  The point is to "force" the different trees to cover different aspects of the data space and problem to learn.  They become somewhat weaker through that which is encounted by building the ensemble of trees.

     

    Typically (also in case of RapidMiner) the subsets are completely random, i.e. overlapping can occur.

     

    Best,

    Ingo

Quick Links