This repo is alpha and dedicated to extending GGUF
llama LLMs with QC data on Agent steriods
- new features will pop up in other ThereminQ repos
- this repo currently serves to test functionality
Functionality added to the ThereminQ stack so far
- agency to ThereminQ-tensors
Qrackmin
+ llama.cpp
+ open-interpreter
+ `` integrated container image stack
docker run --gpus all -v /path-to-/models:/text-generation-webui/models -p 5000:5000 -p 5173:5173 -p 5601:5601 -p 6080:6080 -p 7860:7860 -p 8501:8501 -p 8081:8081 -d twobombs/thereminq-llama[:tag]
latest
includes QC/AI dependancies and downloads a LLama3 modelcli
LLama.cpp compiled versions for direct CLI interaction such as model conversionchatui
for web based LLM and SD interfaces & huggingface URL tunnelagent
for OpenInterpreterUI/CLI with Ollama3 integrationbig-agency
Autogen Studio integrated with Ollama UI
Work in progress
Optional
- Download a ton of hugging face bin files through fetch-bins.sh
Credits for Qrack, LLaMa.cpp and Open Interpreter go to
Dan Strano https://github.com/unitaryfund/qrack
Georgi Gerganov https://github.com/ggerganov/llama.cpp
Open Interpreter project https://www.openinterpreter.com/
AutoGen Studio https://autogen-studio.com/
... and their respective contributers
poem generated by ChatGPT 3