🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru
| Colab | Info |
|---|---|
 |
13B Pro Colab (A100) we need more than 20GB vram 😭 |
|
7B Pro Colab (T4) we need more than 12GB vram 😀 but we need High-RAM 😐 |
https://github.com/Vision-CAIR/MiniGPT-4
https://arxiv.org/abs/2304.10592
https://www.youtube.com/watch?v=WzYBMWc6Zqk
| Model | License |
|---|---|
| https://huggingface.co/lmsys/vicuna-13b-delta-v0 | From https://vicuna.lmsys.org: The online demo is a research preview intended for non-commercial use only, subject to the model License of LLaMA, Terms of Use of the data generated by OpenAI, and Privacy Practices of ShareGPT. Please contact us If you find any potential violation. The code is released under the Apache License 2.0. |
| https://huggingface.co/decapoda-research/llama-13b-hf | https://huggingface.co/decapoda-research/llama-13b-hf/blob/main/LICENSE |
https://runpod.io/gsc?template=9m2wl11ypy&ref=iqi9iy8y
Please copy-paste the code below into a new notebook. (We need more than 20GB vram)
!apt update
!apt-get install git-lfs
!git lfs install
%env HF_HOME=/workspace/cache/huggingface
!git clone -b dev https://github.com/camenduru/minigpt4
!wget https://huggingface.co/ckpt/minigpt4/resolve/main/minigpt4.pth -O /workspace/minigpt4/checkpoint.pth
!wget https://huggingface.co/ckpt/minigpt4/resolve/main/blip2_pretrained_flant5xxl.pth -O /workspace/minigpt4/blip2_pretrained_flant5xxl.pth
!pip install -q salesforce-lavis
!pip install -q bitsandbytes
!pip install -q accelerate
!pip install -q gradio==3.27.0
!pip install -q git+https://github.com/huggingface/transformers -U
%cd /workspace/minigpt4
!python app.py