-
Notifications
You must be signed in to change notification settings - Fork 44.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(backend): Track LLM token usage + LLM blocks cleanup #8367
Conversation
PR Reviewer Guide 🔍Here are some key observations to aid the review process:
|
…milmajdy/add-token-count-as-stats
f845a7e
to
dcf1396
Compare
Background
We are not tracking LLM's token usage.
Changes 🏗️
Testing 🔍
Note
Only for the new autogpt platform, currently in autogpt_platform/