Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Profile RITA RAM Usage #140

Closed
Zalgo2462 opened this issue Sep 11, 2017 · 2 comments
Closed

Profile RITA RAM Usage #140

Zalgo2462 opened this issue Sep 11, 2017 · 2 comments

Comments

@Zalgo2462
Copy link
Contributor

RITA has been seen using a large amount of RAM during log ingestion. This must be investigated and limited.

@Zalgo2462
Copy link
Contributor Author

After preliminary profiling, I cannot figure out why garbage is building up during the import step. References should be lost and Go's garbage collector should delete the underlying objects... but its not.

Next up, a bunch of googling. https://deferpanic.com/blog/manual-memory-management-in-go/ has some interesting points on building strings which is what the parser does. Perhaps it can be rewritten with byte streams?

@Zalgo2462
Copy link
Contributor Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants