Hugging Face's logo

legraphista
/
xLAM-8x7b-r-IMat-GGUF

Text Generation
GGUF
PyTorch
English
function-calling
LLM Agent
tool-use
mistral
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
Model card Files Community
xLAM-8x7b-r-IMat-GGUF
File size: 3,804 Bytes 
ddb2751
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
881ee34
0a7f000
126689c
c00de3c
7af91cc
8df291b
98bc994
876e354
766a246
0974bfe
5740e54
d80e770
744016e
71f19a6
c628984
de6c1dc
7415191
3f0bcf7
0a1cf13
59ffb2b
2e56970
baf43f5
1cf2526
31076c1
94077cd
1b0becf
35b2568
8cb5438
47bb2f9
70d3251
65f2cda
d325542
910f4b5
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
 
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q8_0/xLAM-8x7b-r.Q8_0-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q8_0/xLAM-8x7b-r.Q8_0-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q8_0/xLAM-8x7b-r.Q8_0-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.BF16/xLAM-8x7b-r.BF16-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.BF16/xLAM-8x7b-r.BF16-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.BF16/xLAM-8x7b-r.BF16-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.BF16/xLAM-8x7b-r.BF16-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.FP16/xLAM-8x7b-r.FP16-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.FP16/xLAM-8x7b-r.FP16-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.FP16/xLAM-8x7b-r.FP16-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.FP16/xLAM-8x7b-r.FP16-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
xLAM-8x7b-r.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text