Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Microsoft Azure Endpoints #32

Closed
64bit opened this issue Jan 2, 2023 · 5 comments · Fixed by #67
Closed

Support Microsoft Azure Endpoints #32

64bit opened this issue Jan 2, 2023 · 5 comments · Fixed by #67
Labels
enhancement New feature or request

Comments

@64bit
Copy link
Owner

64bit commented Jan 2, 2023

Add support for :

@64bit 64bit added good first issue Good for newcomers help wanted Extra attention is needed and removed help wanted Extra attention is needed good first issue Good for newcomers labels Jan 2, 2023
@64bit
Copy link
Owner Author

64bit commented Jan 24, 2023

@Kakise
Copy link

Kakise commented Apr 11, 2023

I made something quick because I got access: https://github.com/Kakise/az-openai-rs you can check it out and I can test your changes if needed @64bit

@64bit
Copy link
Owner Author

64bit commented Apr 11, 2023

Nice project! Thank you for offering to test @Kakise!
I might attempt to implement support over weekend, and let you know when ready for testing.

Does it support all the same APIs as OpenAI? Are there any major difference you noticed other than the mechanics of API call?

@Kakise
Copy link

Kakise commented Apr 12, 2023

@64bit right now I only tested completions and embeddings but it does support all OpenAI APIs.

The main difference I noticed is how you call your model. For OpenAI it's passed in the body and for Azure it's passed in the url

@64bit
Copy link
Owner Author

64bit commented Apr 28, 2023

Hi @Kakise , thank you for your response, I had opportunity to look into this today and I discovered that only embedding, completions, and chat completions APIs are currently supported in 2023-03-15-preview api version.

SO I have made the changes to support Azure in #67 , I have tested all the examples on OpenAI after this change.

For testing on Azure and make it as simple for you I have added a new example called examples/azure-openai-service with three API calls in it for embedding, completioins and chat completion. You will only need to change api_key, endpoint and deployment id.

Can you please run that example and post output? I can add output to examples/azure-openai-service/README.md

Hope all goes well, thank you for your help on this!

@64bit 64bit added the help wanted Extra attention is needed label May 7, 2023
@64bit 64bit removed the help wanted Extra attention is needed label Jun 15, 2023
@64bit 64bit closed this as completed in #67 Jun 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants