Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Quant-Cartel
/
magnum-72b-v1-iMat-GGUF
like
3
Follow
Quant Cartel
16
GGUF
chat
qwen
opus
Inference Endpoints
imatrix
conversational
License:
tongyi-qianwen
Model card
Files
Files and versions
Community
Deploy
Use this model
9e96761
magnum-72b-v1-iMat-GGUF
1 contributor
History:
13 commits
InferenceIllusionist
Upload magnum-72b-v1-iMat-Q4_K_M.gguf
9e96761
verified
5 months ago
.gitattributes
2.64 kB
Upload magnum-72b-v1-iMat-Q4_K_M.gguf
5 months ago
LICENSE
0 Bytes
initial commit
5 months ago
README.md
1.31 kB
Update README.md
5 months ago
magnum-72b-v1-iMat-IQ1_M.gguf
23.7 GB
LFS
Upload magnum-72b-v1-iMat-IQ1_M.gguf
5 months ago
magnum-72b-v1-iMat-IQ1_S.gguf
22.7 GB
LFS
Upload magnum-72b-v1-iMat-IQ1_S.gguf
5 months ago
magnum-72b-v1-iMat-IQ2_S.gguf
27.9 GB
LFS
Upload magnum-72b-v1-iMat-IQ2_S.gguf
5 months ago
magnum-72b-v1-iMat-IQ2_XS.gguf
27.1 GB
LFS
Upload magnum-72b-v1-iMat-IQ2_XS.gguf
5 months ago
magnum-72b-v1-iMat-IQ2_XXS.gguf
25.5 GB
LFS
Upload magnum-72b-v1-iMat-IQ2_XXS.gguf
5 months ago
magnum-72b-v1-iMat-IQ3_XXS.gguf
31.8 GB
LFS
Upload magnum-72b-v1-iMat-IQ3_XXS.gguf
5 months ago
magnum-72b-v1-iMat-Q4_K_M.gguf
47.4 GB
LFS
Upload magnum-72b-v1-iMat-Q4_K_M.gguf
5 months ago
magnum-72b-v1-iMat-Q5_K_M-00001-of-00002.gguf
45 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q5_K_M-00002-of-00002.gguf
9.46 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q5_K_S-00001-of-00002.gguf
45 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q5_K_S-00002-of-00002.gguf
6.41 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q6_K-00001-of-00002.gguf
44.8 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q6_K-00002-of-00002.gguf
19.6 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q8_0-00001-of-00002.gguf
45 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q8_0-00002-of-00002.gguf
32.3 GB
LFS
Upload 2 files
5 months ago
