Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add support for service tier in openai_dart #494

Merged
merged 1 commit into from
Jul 18, 2024
Merged

Conversation

davidmigloz
Copy link
Owner

@davidmigloz davidmigloz commented Jul 18, 2024

Specifies the latency tier to use for processing the request. This parameter is relevant for customers subscribed to the scale tier service:

  • If set to 'auto', the system will utilize scale tier credits until they are exhausted.
  • If set to 'default', the request will be processed using the default service tier with a lower uptime SLA and no latency guarantee.

When this parameter is set, the response body will include the service_tier utilized.

@davidmigloz davidmigloz self-assigned this Jul 18, 2024
@davidmigloz davidmigloz added t:enhancement New feature or request p:openai_dart openai_dart package. labels Jul 18, 2024
@davidmigloz davidmigloz added this to the v0.8.0 milestone Jul 18, 2024
@davidmigloz davidmigloz merged commit 0838e4b into main Jul 18, 2024
1 check passed
@davidmigloz davidmigloz deleted the service-tier branch July 18, 2024 22:19
KennethKnudsen97 pushed a commit to KennethKnudsen97/langchain_dart that referenced this pull request Oct 1, 2024
KennethKnudsen97 pushed a commit to KennethKnudsen97/langchain_dart that referenced this pull request Oct 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
p:openai_dart openai_dart package. t:enhancement New feature or request
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

1 participant