Volko76 commited on
Commit
0832eda
1 Parent(s): 5916674
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -18,6 +18,11 @@ tags:
18
 
19
  # Qwen2.5-Coder-32B-Instruct-GGUF
20
 
 
 
 
 
 
21
  ## Introduction
22
 
23
  Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen). As of now, Qwen2.5-Coder has covered six mainstream model sizes, 0.5, 1.5, 3, 7, 14, 32 billion parameters, to meet the needs of different developers. Qwen2.5-Coder brings the following improvements upon CodeQwen1.5:
 
18
 
19
  # Qwen2.5-Coder-32B-Instruct-GGUF
20
 
21
+ /!\ I didn’t quantize this model myself—it's due to the need for a larger GPU that I can’t afford on my own.
22
+ If you'd like to see a donation system for GPU rental to quantize models, let me know in the community section! /!\
23
+
24
+ The model and quantization comes directly from the Qwen repo at 18/11/2024
25
+
26
  ## Introduction
27
 
28
  Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen). As of now, Qwen2.5-Coder has covered six mainstream model sizes, 0.5, 1.5, 3, 7, 14, 32 billion parameters, to meet the needs of different developers. Qwen2.5-Coder brings the following improvements upon CodeQwen1.5: