bartowski
/

Monstral-123B-v2-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Monstral-123B-v2-GGUF

1 contributor

History: 17 commits

bartowski's picture

Upload Monstral-123B-v2-IQ3_XXS.gguf with huggingface_hub

0d9c8d5 verified about 1 month ago

Monstral-123B-v2-IQ3_M
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-IQ4_NL
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-IQ4_XS
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q3_K_L
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q3_K_M
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q3_K_S
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q3_K_XL
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q4_0
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q4_0_8_8
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q4_K_M
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q4_K_S
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q5_K_M
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q5_K_S
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q6_K
Upload folder using huggingface_hub about 1 month ago
Monstral-123B-v2-Q8_0
Upload folder using huggingface_hub about 1 month ago
.gitattributes

5.2 kB

Upload Monstral-123B-v2-IQ3_XXS.gguf with huggingface_hub about 1 month ago
Monstral-123B-v2-IQ3_XXS.gguf

47 GB
LFS

Upload Monstral-123B-v2-IQ3_XXS.gguf with huggingface_hub about 1 month ago