Community & Support
Learn
Marketplace
Discussions
Categories
Discussions
- General
- Platform
- Academic
- Partner
- Regional
User Groups
Documentation
Events
Altair Exchange
- Share or Download Projects
Resources
Employee Resources
- This tab can be seen by employees only. Please do not share these resources externally.
Groups
- Join a User Group
Support

Altair RISE

A program to recognize and reward our most engaged community members

Nominate Yourself Now!

Home
Discussions
Community Q&A

have anyone used RapidMiner for BigData?

Hi
I'm new to RapidMiner. And I was wondering has anyone used RapidMiner for BigData like tens of terabytes of data. How does it perform? ::)

Find more posts tagged with

AI Studio

Accepted answers

All comments

MariusHelf

Hi Bibby,

most operators of RapidMiner need a copy of the data in main memory. For data of this size this is obviously not feasible, so in most cases RapidMiner cannot handle this amount of data at once. But usually you perform some sampling though and work just on parts of the data, and RapidMiner provides a good interface to common databases, so you can the the samples directly from your database. Additioanlly we are currently implementing some algorithms to work directly inside the database, so the data is not at all copied to the RapidMiner memory.

Cheers,
Marius

Quick Links

All Categories
Recent Discussions
Activity
Unanswered
日本語 (Japanese)
한국어(Korean)
Groups