Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Db support #185

Closed
wants to merge 15 commits into from
Closed

Db support #185

wants to merge 15 commits into from

Conversation

ElishaKay
Copy link
Collaborator

@ElishaKay ElishaKay commented Sep 14, 2023

Optionally save logs & reports in MongoDB

@ElishaKay
Copy link
Collaborator Author

ElishaKay commented Sep 14, 2023

Added the 2 relevant services to consume the logs & save them in mongo.
Adding now the relevant changes to the gpt-researcher python service - will update when complete

@ElishaKay
Copy link
Collaborator Author

All required files added.
Tested on Mac & all tests pass
Ready for review

Copy link

@notvicent3 notvicent3 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thats awesome!

@ElishaKay
Copy link
Collaborator Author

Closing for now since there's a chance that commits were squashed on this branch.

We might be able to leverage the JavaScript code in this branch on the upcoming NextJS server, but should probably:

  • remove the Kafka middleman
  • save in postgres instead of mongodb
  • leverage the stream_output function

Requires design review if we'd like to implement Langchain Retrievers which leverage a PGVector as proposed by this user in the discord.

@ElishaKay ElishaKay closed this Jun 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants