Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for model version in Vertex AI #1496

Merged
merged 6 commits into from
Sep 27, 2024

Conversation

pocman
Copy link
Contributor

@pocman pocman commented Sep 27, 2024

Bumping the version of Gemini from gemini-1.5-pro-001 to gemini-1.5-pro-002 should be completly transparent for the user.
Right now, this is not the case as the Gemini model version is strongly coupled with the HuggingChat model.

This PR add supports for extraBody.model_version in endpointVertexParametersSchema

Copy link
Collaborator

@nsarrazin nsarrazin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the contrib!

Long term we probably want to move the extraBody and defaultHeaders arguments out from endpoint-specific implementations and make it accessible to all endpoint types but that shouldn't be a blocker for this PR 🚀

@pocman
Copy link
Contributor Author

pocman commented Sep 27, 2024

@nsarrazin I'm not sure I can merge the PR. Could you do it when you believe it's good to go ?

@nsarrazin nsarrazin merged commit 3f659ae into huggingface:main Sep 27, 2024
4 checks passed
ice91 pushed a commit to ice91/chat-ui that referenced this pull request Oct 30, 2024
* Add support for model version in Vertex AI

* Update src/lib/server/endpoints/google/endpointVertex.ts

Co-authored-by: goupilew <[email protected]>

* fix: optional chaining on extraBody

---------

Co-authored-by: goupilew <[email protected]>
Co-authored-by: Nathan Sarrazin <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants