#

llama-cpp-python

Here are 31 public repositories matching this topic...

biniou

Woolverine94 / biniou

a self-hosted webui for 30+ generative ai

Updated Dec 15, 2024
Python

jasonacox / TinyLLM

Setup and run a local LLM and Chatbot using consumer grade hardware.

chatbot artificial-intelligence openai rag large-language-models llm vllm retrieval-augmented-generation llama-cpp-python

Updated Dec 10, 2024
JavaScript

Aesthisia / LLMinator

Gradio based tool to run opensource LLM models directly from Huggingface

python streaming opensource cpu chatbot cuda openai gradio huggingface model-conversion websockets-chat llm safetensors langchain llamacpp llm-inference ollama llama-cpp-python gguf

Updated Jun 27, 2024
Python

unixwzrd / oobabooga-macOS

Information on optimizing python libraries specifically for oobabooga to take advantage of Apple Silicon and Accelerate Framework.

macos journal numpy pytorch blas oobabooga llama-cpp-python

Updated Nov 28, 2024
Python

mlc-delgado / pytldr-oss

An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intelligent assistant for modern professionals.

docker cassandra docker-compose python3 gradio llama2 llama-cpp-python

Updated Aug 1, 2024
Python

ossirytk / llama-cpp-chat-memory

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

chatbot spacy ner llama-cpp langchain-python chromadb chainlit llama2 llama-cpp-python gguf

Updated Oct 7, 2024
Python

BorjaOteroFerreira / IALab-Suite

Tool for test diferents large language models without code.

api-rest chat-application flask-api inference-api large-language-models llm local-inference llamacpp llm-inference llama2 llama-cpp-python llama2-7b mixtral-8x7b

Updated Sep 17, 2024
JavaScript

erfanzar / AgentX

AgentX is an Open-source library that help people use LLMs on their own computers or help them to serve LLMs as easy as possible that support multi-backends like PyTorch, llama.cpp, Ollama and EasyDeL

nlp machine-learning jax llama-cpp ollama llama-cpp-python easydel

Updated May 24, 2024
Python

laelhalawani / gguf_modeldb

A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b

database inference python3 llama model-database hugginface llm llama2 llama-cpp-python

Updated Jan 13, 2024
Python

007prateekd / fin-edubot

A financial chatbot powered by an LLM and retrieval-augmented generation.

finance chatbot web-scraping finchat large-language-models llm llama-cpp llm-inference retrieval-augmented-generation llama-cpp-python

Updated Oct 2, 2023
Jupyter Notebook

woheller69 / LLAMA_TK_CHAT

Simple chat interface for local AI using llama-cpp-python and llama-cpp-agent

gui llm-inference llama-cpp-python llama-cpp-agent

Updated Jul 27, 2024
Python

TAO71-AI / I4.0

TAO71 I4.0 is an AI created by TAO71 in C# and Python.

Updated Nov 21, 2024
Python

svjack / CodeActAgent-Gradio

UnOfficial Gradio Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.

Updated Sep 30, 2024
Jupyter Notebook

BetoAvila / the-silent-cartographer_youtube

YouTube API implementation with Meta's Llama 2 to analyze comments and sentiments

python docker numpy youtube-api pandas pytorch miniconda docker-secrets google-api-python-client youtube-comment-scraper youtube-comment-sentiment-analysis llms llamacpp llama-cpp llama2 llama2-docker llama-cpp-python llama2-7b

Updated Dec 5, 2023
Python

controlecidadao / samantha_ia

Experimental interface environment for open source LLM, designed to democratize the use of AI. Powered by llama-cpp, llama-cpp-python and Gradio.

Updated Dec 7, 2024
Python

wambugu71 / OfflineGPT-

Local gpt in llama.cpp models with chat interface

python python3 openai streamlit llamacpp llama-cpp-python

Updated Jun 10, 2024
Python

svjack / Genshin-Impact-RAG

A Genshin Impact Question Answer Project supported by Qwen1.5-14B-Chat

prompt embeddings llama embedding rag genshin-impact llm llama-cpp qwen llama-cpp-python gguf qwen1-5 qwen14b

Updated Jun 4, 2024
Python

perpendicularai / SeKernel_for_LLM_UI

This is the repository for the UI for the SeKernel_for_LLM module

chat internet pyqt5 database-management semantic-kernel llama-cpp-python

Updated Aug 17, 2024
Python

nick-konovalchuk / christian-compass

This is a Christian Apologetic chatbot prototype.

rag weaviate streamlit sentence-transformers llama-cpp-python

Updated May 12, 2024
Python

darshpanchal / llm-server

Serving open source models of your choice in as a docker container using llama-cpp-python's OpenAI compatible server

server openai llm llama-cpp-python

Updated Apr 7, 2024
Dockerfile

Improve this page

Add a description, image, and links to the llama-cpp-python topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llama-cpp-python topic, visit your repo's landing page and select "manage topics."