Altair RISE

A program to recognize and reward our most engaged community members

Nominate Yourself Now!

Neural Network: show current cycle number and error value during training

Hi everyone,

I'm quite new in RapidMiner. I'm using Neural Network to train a 300 dimensional dataset with 3000 examples. I set the number of training cycles to 3000 with a learning rate of 0.01, so it takes quite a long time to train. I want to ask if there is a way to show the current cycle number and the error value of that cycle during the training. This will help me to check the progress and estimate how much time left of the training. Thank you very much for your answers.

Best regards.

phivu

Find more posts tagged with

AI Studio

Errors

Deep Learning + Neural Nets

Accepted answers

MartinLiebig

Hi,

the new Deep Learning operator in 7.2 has the expert option to show you the progress (MSE vs epochs).

~Martin

All comments

Thomas_Ott

Yes, you can use a log operator and create a column for training cycle and another column for performance measure.

Quick question, do you need 300 dimensions? Can you do some feature optimization to knock down the dimensions?

phivu

Thanks Thomas, as I know log operator can only show the final info after we finish training the NN, is there any way to show the info (e.g. the number of cycles run so far, the error of each cycle) during the training, to help estimate how much time left to wait for the training?

P/S: Yes, I used PCA to reduce the dimensions to 171, it runs faster, but I want to improve the accuracy, so I set a small learning rate (0.01) and a large number of cycles (10000), which takes more time to run.

Thomas_Ott

There might be a way to loop the training cycle values and then log the execution time. That could give you an idea of how long a certain value of training cycles will take.

While this might not work in your case but n version 7+ there is an estimated time of completion on the operator itself. If you have your NN inside a X-val, you would see a dark circle with a % on the X-val operator. It's just an estimate but if it takes 1 hour to get to 1%, then it's a safe bet it will take 100 hrs.

MartinLiebig

Hi,

the new Deep Learning operator in 7.2 has the expert option to show you the progress (MSE vs epochs).

~Martin

Thomas_Ott

YAH!

SimbaD

I have spent a couple of days trying this, but I still cant figure this out. I was to plot MSE Vs iteration. Can you please explain your answer a little bit more. I am using a deep-learning operator, and I want to show its training progress through the MSE vs epoch/iteration.

sgenzer

hello @SimbaD welcome to the community! I'd recommend tagging people on your post (like I did for you) - this is an old thread.

Scott