munish0838 commited on
Commit
97128bc
1 Parent(s): 7100786

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -1
README.md CHANGED
@@ -8,4 +8,26 @@ tags:
8
  - code
9
  inference: false
10
  base_model: codellama/CodeLlama-7b-hf
11
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  - code
9
  inference: false
10
  base_model: codellama/CodeLlama-7b-hf
11
+ ---
12
+
13
+
14
+ # CodeLlama-7b-hf-GGUF
15
+ - Quantized version of [CodeLlama-7b-hf](https://huggingface.co/codellama/CodeLlama-7b-hf)
16
+ - Created using llama.cpp
17
+
18
+ ## Available Quants
19
+
20
+ * Q2_K
21
+ * Q3_K_L
22
+ * Q3_K_M
23
+ * Q3_K_S
24
+ * Q4_0
25
+ * Q4_K_M
26
+ * Q4_K_S
27
+ * Q5_0
28
+ * Q5_K_M
29
+ * Q5_K_S
30
+ * Q6_K
31
+ * Q8_0
32
+
33
+ ReadMe format inspired from [mlabonne](https://huggingface.co/mlabonne)