Hugging Face's logo

RachidAR
/
Marx-3b-v3-gguf

GGUF
English
Inference Endpoints
Model card Files Community
1

Experimental! https://github.com/ggerganov/llama.cpp/pull/3586

Downloads last month
66
GGUF
Model size
2.8B params
Architecture
stablelm

3-bit

4-bit

5-bit

6-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Dataset used to train RachidAR/Marx-3b-v3-gguf