-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use tracked-consumers memory pool be the default. #11949
Use tracked-consumers memory pool be the default. #11949
Conversation
gcp c3d-standard-4 Benchmark clickbench_1
Benchmark clickbench_extended
Benchmark tpch_mem_sf1
Benchmark tpch_sf1
|
I am going to re-run the benchmarks on my machine and see what I get |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @wiedld
I think this is a good change in my opinion. If we have some time to look into profiling and see the memory pool show up at all, we can re-asses.
Also there is a workaround if anyone experiences a performance slowdown due to this change (which is to verride the memory pool)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm thanks @wiedld
I think it is good for now, perhaps in future if there are lots of memory consumers then the error message might be unreadbale
Absolutely agreed. I set the default to have the top 5 consumers listed, altho we can change that based on readability. |
* feat(11523): set the default memory pool to the tracked-consumer pool * test(11523): update tests for the OOM message including the top consumers * chore(11523): remove duplicate wording from OOM messages
* feat(11523): set the default memory pool to the tracked-consumer pool * test(11523): update tests for the OOM message including the top consumers * chore(11523): remove duplicate wording from OOM messages
Which issue does this PR close?
Closes #11523
Rationale for this change
We would like the improved OOM error messages, which lists the top overall memory reservation consumers, to be the default.
What changes are included in this PR?
Make
TrackConsumersPool
be the default.Include benchmarks to assess potential performance overhead from added mutex.
Are these changes tested?
Yes, for the existing tests using the default pool.
Are there any user-facing changes?
No API changes.
Change in OOM messages returned.