OpenAI vs VertexAI

[mmistroni]

Hey
this is not a bug, rather a request for info
First off great project!
Secondly, you mention in README that i need an OpenAI key to leverage openbb agents.
Unfortunately i exhausted my credits with OpenAI and now i cannot do anything.
Wanted to leverage VertexAI (or Claude) but i cannot see in the code base where is the link between openbb agents and OpenAI...
the only link i can find is import from langchain_openai import OpenAIEmbeddings

So i guess if i can somehow 'inject' this package langchain-google-vertexai in the flow, i shoud be able to use your openbb agents with VertexAI?

Could you please advise and perhaps suggest some resources i can have a look at to get familiar with this langchain stuff?
FYI i am already an OpenBB user.... so i guess i just need to learn 'the other half' of the openbb agents equation

Many thanks
Marco

[mnicstruwig]

Hey @mmistroni,

Thanks for reaching out.

We use magentic (Github) as our LLM framework in openbb-agents.

By default, we use GPT-4o as our model. magentic has good support for Anthropic models (eg. Opus), and I think VertexAI via LiteLLM (but I'll have to confirm).

Give me a few days, and I'll add something to allow you to specify which model to use.

I can't guarantee those models will perform as well as GPT-4o (which is really good at function calling), and our system prompts are specifically targeting GPT-4o, but there's no harm in opening things up and trying.

[mmistroni]

That would be great, thank you! But let me try it myself so I can learn how all of this fit together.i have no urgency for this.thanks

…

On Fri, 14 Jun 2024, 08:19 Michael Struwig, ***@***.***> wrote: Hey @mmistroni <https://github.com/mmistroni>, Thanks for reaching out. We use magentic (Github <https://github.com/jackmpcollins/magentic>) as our LLM framework in openbb-agents. By default, we use GPT-4o as our model. magentic has good support for Anthropic models (eg. Opus), and I *think* VertexAI via LiteLLM (but I'll have to confirm). Give me a few days, and I'll add something to allow you to specify which model to use. I can't guarantee those models will perform as well as GPT-4o (which is *really* good at function calling), and our system prompts are specifically targeting GPT-4o, but there's no harm in opening things up and trying. — Reply to this email directly, view it on GitHub <#25 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACPNCDVYXSVL6ZWUC3TOXOTZHKKQZAVCNFSM6AAAAABJAYJLKSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNRXGM4TGOJZGM> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[djesus-shell]

Hey @mmistroni,

Thanks for reaching out.

We use magentic (Github) as our LLM framework in openbb-agents.

By default, we use GPT-4o as our model. magentic has good support for Anthropic models (eg. Opus), and I think VertexAI via LiteLLM (but I'll have to confirm).

Give me a few days, and I'll add something to allow you to specify which model to use.

I can't guarantee those models will perform as well as GPT-4o (which is really good at function calling), and our system prompts are specifically targeting GPT-4o, but there's no harm in opening things up and trying.

i would love to use Anthropic... any idea when this will be available? thank you in advance! :D

[mmistroni]

Hello i am getting this error running the sample

ImportError: Could not import faiss python package. Please install it with pip install faiss-gpu (for CUDA supported GPU) or pip install faiss-cpu (depending on Python version).

could you pls advise?
regards