RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Standardized Serverless ML Inference Platform on Kubernetes

An Open Source Python alternative to NotebookLM's podcast feature: Transforming Multimodal Content into Captivating Multilingual Audio Conversations with GenAI

The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices

Optimizing inference proxy for LLMs

Notes, Python demos / notebooks, and free chapters for the 2nd edition of the university textbook "Machine Learning Refined".

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

Neural Network Compression Framework for enhanced OpenVINO™ inference

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

An open-source framework for collaborative AI agents, enabling diverse, distributed agents to team up and tackle complex tasks through internet-like connectivity.

An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.

A collection of sample programs, notebooks, and tools which highlight the power of the MAX Platform

OpenAI-Compatible RESTful APIs for Amazon Bedrock

podcastfy.ai gradio demo app

Python client library for Modal

Convenience scripts to finetune (chat-)LLaMa3 and other models for any language

GenAIOps with Prompt Flow is a "GenAIOps template and guidance" to help you build LLM-infused apps using Prompt Flow. It offers a range of features including Centralized Code Hosting, Lifecycle Management, Variant and Hyperparameter Experimentation, A/B Deployment, reporting for all runs and experiments and so on.

MLRun/Iguazio/Nuclio quality gate solution. The solution checks a quality of MLRun implementation/delivery.