OpenAI Realtime API integration?

[pietz]

Is there any support planned for the OpenAI Realtime API? It would be great to have a speech to speech conversation by connecting directly to OpenAI via websocket or by using a relay server to handle futher function calls.

[OvidijusParsiunas]

Hi @pietz.
I am currently finishing up the features for the upcoming release.
The new OpenAI Realtime API is something will be one of the first things that I will be picking up in the next release (hopefully starting next month), so look out for that!

[pietz]

I'm building my first project with deep chat to find some form of standard on the frontend side of things and I love it so far. Much appreciate your work!

Can I read something about upcoming features somewhere? Would be interested to know what you're working on.

[OvidijusParsiunas]

I have not defined an official Roadmap for the release after the upcoming one, however I will mostly be following the open issue requests. I do expect that the focus of the enhancements will be relating to new AI APIs such as OpenAI Realtime API, Gemini, Claud etc.

I will keep this issue open until I have completed the OpenAI Realtime API integration.

Thanks!