Hugging Face's logo

legraphista
/
Mistral-Large-Instruct-2407-IMat-GGUF

Text Generation
GGUF
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
Model card Files Community
Mistral-Large-Instruct-2407-IMat-GGUF
File size: 6,951 Bytes 
8d281bc
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2ded83c
b7e6569
43d6220
e433a13
c37243e
7811fc4
f5dcfa5
5e8eb8c
ca9785e
8a6a71d
4dc4bb8
45fdbfa
bd933a1
29fc787
8335b7d
8b0c5d8
22067c4
54c84de
58b6b61
d29424e
692feb4
fcea172
0a7df1e
7b8b926
0a66eb9
73d55c6
e1c00fd
e526a8b
0b29b05
4fe40d3
4b0e59f
b82dc42
86e2c30
3478fa4
dedea4c
22b0518
4179ead
9f164af
543667d
b69bc57
9084870
c69833d
cf3d01b
ea91a71
c99c24e
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
 
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q8_0/Mistral-Large-Instruct-2407.Q8_0-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q8_0/Mistral-Large-Instruct-2407.Q8_0-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q8_0/Mistral-Large-Instruct-2407.Q8_0-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q8_0/Mistral-Large-Instruct-2407.Q8_0-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q8_0/Mistral-Large-Instruct-2407.Q8_0-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q6_K/Mistral-Large-Instruct-2407.Q6_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q8_0/Mistral-Large-Instruct-2407.Q8_0-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q6_K/Mistral-Large-Instruct-2407.Q6_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q6_K/Mistral-Large-Instruct-2407.Q6_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q6_K/Mistral-Large-Instruct-2407.Q6_K-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q6_K/Mistral-Large-Instruct-2407.Q6_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.BF16/Mistral-Large-Instruct-2407.BF16-00004-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.BF16/Mistral-Large-Instruct-2407.BF16-00011-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.BF16/Mistral-Large-Instruct-2407.BF16-00003-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.BF16/Mistral-Large-Instruct-2407.BF16-00010-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.BF16/Mistral-Large-Instruct-2407.BF16-00007-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.BF16/Mistral-Large-Instruct-2407.BF16-00005-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.BF16/Mistral-Large-Instruct-2407.BF16-00009-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.BF16/Mistral-Large-Instruct-2407.BF16-00001-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.BF16/Mistral-Large-Instruct-2407.BF16-00008-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.BF16/Mistral-Large-Instruct-2407.BF16-00006-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.BF16/Mistral-Large-Instruct-2407.BF16-00002-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.FP16/Mistral-Large-Instruct-2407.FP16-00011-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.FP16/Mistral-Large-Instruct-2407.FP16-00009-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.FP16/Mistral-Large-Instruct-2407.FP16-00004-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.FP16/Mistral-Large-Instruct-2407.FP16-00002-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.FP16/Mistral-Large-Instruct-2407.FP16-00007-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.FP16/Mistral-Large-Instruct-2407.FP16-00003-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.FP16/Mistral-Large-Instruct-2407.FP16-00005-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.FP16/Mistral-Large-Instruct-2407.FP16-00008-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.FP16/Mistral-Large-Instruct-2407.FP16-00010-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.FP16/Mistral-Large-Instruct-2407.FP16-00001-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.FP16/Mistral-Large-Instruct-2407.FP16-00006-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q5_K/Mistral-Large-Instruct-2407.Q5_K-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q5_K/Mistral-Large-Instruct-2407.Q5_K-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q5_K/Mistral-Large-Instruct-2407.Q5_K-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q5_K_S/Mistral-Large-Instruct-2407.Q5_K_S-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q5_K/Mistral-Large-Instruct-2407.Q5_K-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q5_K_S/Mistral-Large-Instruct-2407.Q5_K_S-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q5_K_S/Mistral-Large-Instruct-2407.Q5_K_S-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q4_K/Mistral-Large-Instruct-2407.Q4_K-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q5_K_S/Mistral-Large-Instruct-2407.Q5_K_S-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q4_K/Mistral-Large-Instruct-2407.Q4_K-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Large-Instruct-2407.Q4_K/Mistral-Large-Instruct-2407.Q4_K-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text