Hugging Face's logo

MaziyarPanahi
/
calme-3.3-instruct-3b-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Community
3

Upload folder using huggingface_hub

#2
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+14
-15
Files changed (5) hide show
  1. README.md +6 -7
  2. calme-3.3-instruct-3b.Q5_K_M.gguf +2 -2
  3. calme-3.3-instruct-3b.Q6_K.gguf +2 -2
  4. calme-3.3-instruct-3b.Q8_0.gguf +2 -2
  5. calme-3.3-instruct-3b.fp16.gguf +2 -2
README.md CHANGED
@@ -1,4 +1,10 @@
1
  ---
 
 
 
 
 
 
2
  tags:
3
  - quantized
4
  - 2-bit
@@ -9,13 +15,6 @@ tags:
9
  - 8-bit
10
  - GGUF
11
  - text-generation
12
- - text-generation
13
- model_name: calme-3.3-instruct-3b-GGUF
14
- base_model: MaziyarPanahi/calme-3.3-instruct-3b
15
- inference: false
16
- model_creator: MaziyarPanahi
17
- pipeline_tag: text-generation
18
- quantized_by: MaziyarPanahi
19
  ---
20
  # [MaziyarPanahi/calme-3.3-instruct-3b-GGUF](https://huggingface.co/MaziyarPanahi/calme-3.3-instruct-3b-GGUF)
21
  - Model creator: [MaziyarPanahi](https://huggingface.co/MaziyarPanahi)
 
1
  ---
2
+ base_model: MaziyarPanahi/calme-3.3-instruct-3b
3
+ inference: false
4
+ model_creator: MaziyarPanahi
5
+ model_name: calme-3.3-instruct-3b-GGUF
6
+ pipeline_tag: text-generation
7
+ quantized_by: MaziyarPanahi
8
  tags:
9
  - quantized
10
  - 2-bit
 
15
  - 8-bit
16
  - GGUF
17
  - text-generation
 
 
 
 
 
 
 
18
  ---
19
  # [MaziyarPanahi/calme-3.3-instruct-3b-GGUF](https://huggingface.co/MaziyarPanahi/calme-3.3-instruct-3b-GGUF)
20
  - Model creator: [MaziyarPanahi](https://huggingface.co/MaziyarPanahi)
calme-3.3-instruct-3b.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b71228ce4c485c849272d8ff5dea82dc79e0a5e8ae40ac8db18cd9e80eca62df
3
- size 2225423520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:453f76e0ad70829a0d3bb6685953449433950524dfc6d9c1d66241d498949f9a
3
+ size 2224815264
calme-3.3-instruct-3b.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a096ccd26e18576f5e2d3bfbe80599348c5e7714d5b11534bc797af30f24816a
3
- size 2538767520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e2694f33c6e6c405e52a0752fc44fdf8ddff36d8902889139587b9c5ac57266
3
+ size 2538159264
calme-3.3-instruct-3b.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:071c1dabed4bf8751a280971d1fce91bccf9af4eab1009d8b93f35235b05d6af
3
- size 3286084768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a991b8d3bdc86cc4c4dd1b584dce20911ecceed805ff07756a8707ad7ca6bbe7
3
+ size 3285476512
calme-3.3-instruct-3b.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:af8989e044181ca7469bb6138e2adc2c06f4d2cd622088f7a2723914240c1a44
3
- size 6178925472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62559e290f19ebab68ad0112eab225be377a693c9f3a9609e56b1f7cb7cf424f
3
+ size 6178317472