Skip to content

ThereminQ - LLama QuantOPS : dedicated to interaction and training LLaMa's with QC data

License

Notifications You must be signed in to change notification settings

twobombs/thereminq-llama

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ThereminQ-llama : baking a Quantum layer caek

This repo is alpha and dedicated to extending GGUF llama LLMs with QC data on Agent steriods

  • new features will pop up in other ThereminQ repos
  • this repo currently serves to test functionality

Functionality added to the ThereminQ stack so far

  • agency to ThereminQ-tensors

2a40063099465fee941a701289810666


Qrackmin + llama.cpp + open-interpreter + `` integrated container image stack

docker run --gpus all -v /path-to-/models:/text-generation-webui/models  -p 5000:5000 -p 5173:5173 -p 5601:5601 -p 6080:6080 -p 7860:7860 -p 8501:8501 -p 8081:8081 -d twobombs/thereminq-llama[:tag] 
  • latest includes QC/AI dependancies and downloads a LLama3 model
  • cli LLama.cpp compiled versions for direct CLI interaction such as model conversion
  • chatui for web based LLM and SD interfaces & huggingface URL tunnel
  • agent for OpenInterpreterUI/CLI with Ollama3 integration
  • big-agency Autogen Studio integrated with Ollama UI

Screenshot from 2024-06-01 10-15-20

Screenshot from 2024-06-01 10-20-29

Screenshot from 2024-06-01 10-24-37


Work in progress

QCAI-chat drawio


Optional


Credits for Qrack, LLaMa.cpp and Open Interpreter go to

Dan Strano https://github.com/unitaryfund/qrack

Georgi Gerganov https://github.com/ggerganov/llama.cpp

Open Interpreter project https://www.openinterpreter.com/

AutoGen Studio https://autogen-studio.com/

... and their respective contributers


Untitled

poem generated by ChatGPT 3

About

ThereminQ - LLama QuantOPS : dedicated to interaction and training LLaMa's with QC data

Resources

License

Stars

Watchers

Forks

Packages

No packages published