Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KPL Native Process Memory Leak #497

Closed
kaaphi opened this issue Apr 24, 2023 · 1 comment
Closed

KPL Native Process Memory Leak #497

kaaphi opened this issue Apr 24, 2023 · 1 comment

Comments

@kaaphi
Copy link

kaaphi commented Apr 24, 2023

It appears that 0.14.3 introduced a memory leak in the native process.

See this graph of the KPL native process memory usage:
process_rss

The top two lines are 0.14.3 and 0.15.6. The bottom (flat) line is 0.14.2. These graphs are from three application instances that are identical except for the version of KPL they are using. This a test application whose only operation is to publish to a Kinesis stream in a loop. Eventually, the OS kills the native process and KPL has to restart it. In all three applications, the outstandingRecordsCount stays below 5000, so this does not appear to be back-pressure related.

These are running in ECS with the amazoncorretto docker image on arm64.

It's possible that this is the same issue reported in #447 and #485.

@kaaphi
Copy link
Author

kaaphi commented May 3, 2023

This is looking much better in 0.15.7 (top line is 0.15.6, bottom line is 0.15.7):
kpl_0-15-6_vs_0-15-7

I'm guessing this is due to the changes in PR #498.

@kaaphi kaaphi closed this as completed May 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant