Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

db: consider adapting LoadBlockSema to limit concurrent bytes loaded #4185

Open
jbowens opened this issue Nov 27, 2024 · 0 comments
Open

db: consider adapting LoadBlockSema to limit concurrent bytes loaded #4185

jbowens opened this issue Nov 27, 2024 · 0 comments

Comments

@jbowens
Copy link
Collaborator

jbowens commented Nov 27, 2024

Memory for in-flight reads is allocated before a block can be inserted into the block cache, so these reads do not drawn down from the block cache's memory. A spike in concurrent block loads can cause a spike in memory allocations. The LoadBlockSema semaphore used to limit the count of concurrent loads would probably be more effective as a limit on the concurrent bytes loaded. This might even be a better proxy for concurrent read i/os, since large reads may translate to many individual block i/os (especially as it pertains to cloud platforms concurrent iop budget calculations).

Jira issue: PEBBLE-311

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Incoming
Development

No branches or pull requests

2 participants