🎉Community Raffle - Win $25

An exclusive raffle opportunity for active members like you! Complete your profile, answer questions and get your first accepted badge to enter the raffle.
Join and Win

[SOLVED] Decay Rate of Neural Network

User: "tek"
New Altair Community Member
Updated by Jocelyn
Hey there,
quite simple question, for which I couldn't find an answer in any documentation or thread:

What is the decay rate of the learning rate if you activate the "decay" button on a neural network operator?

Thanks for the answer!

Find more posts tagged with

Sort by:
1 - 2 of 21
    User: "Nils_Woehler"
    New Altair Community Member
    Hi,

    I'm afraid you are right. There is no documentation on how the decay influences the learning rate.
    I've just looked it up from the source code: In every learning iteration the learning rate is diveded by the number of learning iterations plus one. Thus it drops to 1/2, 1/3, 1/4, etc.. of the default learning rate.

    Best,
    Nils 
    User: "tek"
    New Altair Community Member
    OP
    Thanks a lot!