Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Parallelism for Heroku Connect jobs #295

Open
vivekvj01 opened this issue May 21, 2024 · 2 comments
Open

Support Parallelism for Heroku Connect jobs #295

vivekvj01 opened this issue May 21, 2024 · 2 comments
Assignees

Comments

@vivekvj01
Copy link

Required Terms
I agree to follow this project's Code of Conduct
I have read and accepted the Salesforce Program Agreement
What service(s) is this request for?

Heroku Connect

Tell us about what you're trying to solve. What challenges are you facing?

Customers would like to submit Jobs in using Parallel mode for Bulk api

@vivekvj01 vivekvj01 self-assigned this May 21, 2024
@vivekvj01 vivekvj01 converted this from a draft issue May 21, 2024
@neidenmark
Copy link

Working with a customer who needs to create many millions of records in a short period of time. Due to background processing in Salesforce core each batch of 10.000 takes 2.5-3minutes to complete. When I did some tests with Heroku Connect and calculated for 5M records the total time would be 3.2 days. When testing with Bulk API 1.0 in parallel mode I pushed 1M records in 5 minutes. Ofc jobs needs to be optimized to avoid row locking so Bulk API 2.0 would be preferred.

@vivekvj01
Copy link
Author

Thanks for your feedback. Are looking at providing Parallel mode for Bulk api for Heroku connect.

@ASayre ASayre removed this from Heroku Roadmap Jun 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants