"Data reading from DB in batch"
Hi Gurus,
We have functionality to write specified number of rows to database with 'Write' operator. Is there any way to define the same while reading the data from database. Also How does the data is read from database (in batch or completely)? where this data is kept and processed?
Thanks,
Bhushan
We have functionality to write specified number of rows to database with 'Write' operator. Is there any way to define the same while reading the data from database. Also How does the data is read from database (in batch or completely)? where this data is kept and processed?
Thanks,
Bhushan
Find more posts tagged with
Sort by:
1 - 1 of
11
the Read Database operator always reads the complete data table (or the query you entered) in one big batch. SQL does not provide a simple means to "batchify" database reading. The data is then stored as a RapidMiner Example Set in memory.
Best, Marius