Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
localmodels
/
Guanaco-65B-GPTQ
like
4
Follow
Local Models
38
Text Generation
Transformers
llama
Inference Endpoints
arxiv:
2305.14314
arxiv:
2302.13971
arxiv:
2304.07327
Model card
Files
Files and versions
Train
Deploy
Use this model
ae47724
Guanaco-65B-GPTQ
/
README.md
raffr
guanaco-65b-gptq
ae47724
almost 2 years ago
preview
code
|
raw
Copy download link
history
blame
170 Bytes
## Guanaco 65B GPTQ
From timdettmers: https://huggingface.co/timdettmers/guanaco-65b
### Folders
**ggml:**
q4
_0 and q4_
1
**gptq:**
works with Triton and CUDA branches