Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(analytics): GPU Usage #580

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

0xnirmal
Copy link
Contributor

  • Add Query for GPU Utilization (in aggregate) across all providers
  • Add Query for GPU supply, leases, and utilization by vendor and model
  • Add endpoint support on v1/graph-data/ for GPU Utilization (aggregate)

Todo:

  • Update UI to show GPU Utilization (aggregate)
  • Endpoint support for per vendor / model (will chat with Max on best approach here)

@0xnirmal 0xnirmal requested a review from a team as a code owner December 23, 2024 19:26
);
}

export async function getLatestGpuBreakdown(): Promise<GpuBreakdownData[]> {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we expose this method as a documented route please?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On it - okay to take as a follow-up PR @baktun14?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can add it to this pr, you just need to add a route.


export async function getGpuUtilization() {
return await cacheResponse(
60 * 5, // 5 minutes
Copy link
Contributor

@ygrishajev ygrishajev Jan 14, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there are relevant constants in date-fns, the comment wouldn't be needed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants