"Data reading from DB in batch"

bvirulkar

Hi Gurus,

We have functionality to write specified number of rows to database with 'Write' operator. Is there any way to define the same while reading the data from database. Also How does the data is read from database (in batch or completely)? where this data is kept and processed?

Thanks,
Bhushan

MariusHelf

Hi Bhushan,

the Read Database operator always reads the complete data table (or the query you entered) in one big batch. SQL does not provide a simple means to "batchify" database reading. The data is then stored as a RapidMiner Example Set in memory.

Best, Marius