Quantised models by thebloke
#1
by
choltha
- opened
Find all variants here: https://huggingface.co/models?sort=trending&search=thebloke%2Fhessianai-
For example using llama.ccp + https://huggingface.co/TheBloke/leo-hessianai-13B-chat-bilingual-GGUF/blob/main/leo-hessianai-13b-chat-bilingual.Q4_K_M.gguf will run locally on a Macbook (e.g. M1 Air)
bjoernp
changed discussion status to
closed