How can I control the batch size for Bulk API Query?


Question.

I didn't found an option to control the batch size for bulk select queries and would like to control this.

Actually i need to increase the node memory limit to 16GB for selecting 700.000 Accounts, not sure if this will help.


Answer.

For the Builk Api Query there is no option (technically) to increase or to decrease the Batch Size for the or to do any additional memory optimization during the runtime.

The only option is to increase the node memory size or limit the size of the fetched records by LIMIT or WHERE clauses.

However, for the DML operations you can control the Batch Size of Bulk Api V1.0 by using bulkApiV1BatchSize parameter. See the Full export.json format

Last updated on 13th Nov 2023