Experimental quants for Model-Requests#35 - Hastagaras/Halu-8B-Llama3-Blackroot.

Requester decription: "I don't know what to say about this model... this model is very strange...Maybe because Blackroot's amazing Loras used human data and not synthetic data, hence the model turned out to be very human-like...even the actions or narrations.".

image/png

Downloads last month
50
GGUF
Model size
8.03B params
Architecture
llama

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .