Hugging Face's logo

CalderaAI
/
13B-Ouroboros-GPTQ4bit-128g-CUDA

Text Generation
Transformers
PyTorch
English
llama
alpaca
vicuna
uncensored
Merge
mix
airoboros
openorca
orcamini
orca
instruct
mixtune
GPTQ
quantized
4bit
cuda
text-generation-inference
Inference Endpoints
Model card Files Community

GPTQ 4 bit 128 groupsize CUDA quantization of CalderaAI's 13B Ouroboros:

https://huggingface.co/CalderaAI/13B-Ouroboros

Downloads last month
10
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.

Datasets used to train CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA