Sandbox

Voici comment installer un chatbot sur un Desktop LINUX. 16 Go sont nécessaires.

chatbot

cd
mkdir chatbot
cd chatbot
wget https://huggingface.co/Pi3141/vicuna-13b-v1.1-ggml/resolve/main/ggml-model-q4_2.bin
wget https://github.com/ItsPi3141/alpaca-electron/releases/download/v1.0.5/Alpaca-Electron-linux-x64-v1.0.5.tar.gz
tar -xvf Alpaca-Electron-linux-x64-v1.0.5.tar.gz
cd "release-builds/Alpaca Electron-linux-x64"
./"Alpaca Electron"

• Charger le binaire ggml-model-q4_2.bin
• C'est bon !

old

1. https://www.youtube.com/watch?v=KopKQDmGk_o
2. https://huggingface.co/Pi3141/alpaca-7b-native-enhanced/blob/main/ggml-model-q8_0.bin

1. https://github.com/ItsPi3141/alpaca-electron/releases

1. wget https://huggingface.co/Pi3141/alpaca-7b-native-enhanced/resolve/main/ggml-model-q8_0.bin
2. wget https://huggingface.co/Pi3141/alpaca-7b-native-enhanced/resolve/main/ggml-model-q4_1.bin

https://huggingface.co/Pi3141/alpaca-7b-native-enhanced/resolve/main/consolidated.00.pth

https://huggingface.co/Pi3141/vicuna-13b-v1.1-ggml/resolve/main/ggml-model-q4_2.bin

https://huggingface.co/Pi3141/alpaca-7b-native-enhanced/resolve/main/ggml-model-q4_3.bin

https://huggingface.co/Pi3141/alpaca-7b-native-enhanced/resolve/main/ggml-model-q4_1.bin