How do I adjust the batch size for a Bulk API Query?

Question

I'm unable to find an option to control the batch size for bulk select queries and would like to adjust this. Currently, I need to increase the node memory limit to 16GB to select 700,000 Accounts, and I'm not sure if this will be effective.

Answer

For the Bulk API Query, there is no technical option to adjust the batch size or perform memory optimization during runtime. Your options include increasing the node memory size or limiting the size of the fetched records with LIMIT or WHERE clauses.

For DML operations, the batch size for Bulk API V1.0 can be controlled using the bulkApiV1BatchSize parameter. For more details, see the Export.json File Specification.

Last updated on 23rd Apr 2024