RapidMiner generates the Blue Screen of Death

SGolbert
SGolbert New Altair Community Member
edited November 5 in Community Q&A
Hi all,

I wanted to bring the attention to a long lasting problem with RM that I haven't seen reports or developments on. The problem concerns RM Studio running on Windows (it should happen in Linux too though), and involves RM crashing the system when using too much memory.

It has happen to me also when using good machines (32 GB RAM), specially when running something in AutoModel in the background. I thougth the JVM was inmune to these issues, but that is clearly not the case.

Is the software development team aware of the problem or doing something to prevent it? The ideal solution would be to abort the process (one of them, in case multiple process are running). At the worst close all process and RM itself. But NEVER crash my OS!

Regards,
Sebastian
Tagged:

Best Answers

  • varunm1
    varunm1 New Altair Community Member
    edited August 2019 Answer ✓
    I too agree with @SGolbert. If RAM usage is high the windows is getting stuck and I need to manually power cycle the system . I raised this earlier but I got suggestions to limit RAM in RM preferences.
  • hughesfleming68
    hughesfleming68 New Altair Community Member
    edited August 2019 Answer ✓
    This can be a complex issue. I solved all my BSOD problems by doing the following. Set a physical limit to memory and switch off hyperthreading. In my tests, both the JVM and Python/Tensorflow were faster with hyperthreading off. This may be due to various security mitigations that were introduced in the last 24 months. Lastly, switch off this nasty piece of software from Intel that is used to adjust turbo boost that Windows would install automatically. It took me a few months to sort that one out.

    On windows, I would install whocrashed. It lets you know which driver is ruining your day. https://resplendence.com/whocrashed. This is a crash dump analyser.

    Take a picture of the BSOD and post it. In my experience, it has nothing to do with the JVM.

Answers

  • varunm1
    varunm1 New Altair Community Member
    edited August 2019 Answer ✓
    I too agree with @SGolbert. If RAM usage is high the windows is getting stuck and I need to manually power cycle the system . I raised this earlier but I got suggestions to limit RAM in RM preferences.
  • SGolbert
    SGolbert New Altair Community Member

    That's a good work around, if it works. I still wonder why does the OS crash. Isn't it possible to use virtual memory?

  • varunm1
    varunm1 New Altair Community Member
    Actually, it should throw an outofmemory error and stop. I am not sure why its crashing OS. May be @Marco_Boeck have some insights.
  • hughesfleming68
    hughesfleming68 New Altair Community Member
    edited August 2019 Answer ✓
    This can be a complex issue. I solved all my BSOD problems by doing the following. Set a physical limit to memory and switch off hyperthreading. In my tests, both the JVM and Python/Tensorflow were faster with hyperthreading off. This may be due to various security mitigations that were introduced in the last 24 months. Lastly, switch off this nasty piece of software from Intel that is used to adjust turbo boost that Windows would install automatically. It took me a few months to sort that one out.

    On windows, I would install whocrashed. It lets you know which driver is ruining your day. https://resplendence.com/whocrashed. This is a crash dump analyser.

    Take a picture of the BSOD and post it. In my experience, it has nothing to do with the JVM.
  • Marco_Boeck
    Marco_Boeck New Altair Community Member
    Hi,

    To be perfectly honest here, I'd love it if I could create bluescreens by coding regular Java :# , but the truth is, I cannot. If something happens, it would be outside of our control, like a result of some unfortunate combination of the Java VirtualMachine and other external factors like @hughesfleming68 mentioned above.

    Therefore there is pretty much nothing we can do on our end.

    Regards,
    Marco

Categories