"How to speed up logistic regression?"

Username
Username New Altair Community Member
edited November 5 in Community Q&A
Hi,

the logistic regression operator has several parameters. I'm currently using it with the default values. I have ~150 attributes and ~300 000 examples. What parameters can speed up the learning process without decreasing the regression quality too much?

Thanks
Tagged:

Answers

  • stereotaxon
    stereotaxon New Altair Community Member
    Not to disrespect RapidMiner, but if you might want to try R for the analysis. 

    make sure you have lots of memory, and fast memory at that.

    -Mike
  • TobiasMalbrecht
    TobiasMalbrecht New Altair Community Member
    Hi,

    since logistic regression uses an evoluationary approach to find an optimal solution you can reduce the runtime by specifying smaller values for the parameters [tt]max_generations[/tt] or [tt]population_size[/tt]. However you have to be aware, that it is more unlikely to find an optimal solution the more you put constraints on the parameters.

    Besides, there are to Weka operators that use other model fitting approaches. Maybe you might want to try these, so you do not have to leave RapidMiner completely! ;)

    Regards,
    Tobias
  • Username
    Username New Altair Community Member
    The W-Logistic operator from WEKA is indeed much faster :).
  • IngoRM
    IngoRM New Altair Community Member
    Hi,

    and I want to give a hint to our Kernel logistic regression approach "MyKLRLearner" which in my experience is again faster  ;)

    Cheers,
    Ingo

Categories