Pelochus commited on
Commit
71f0fc0
1 Parent(s): 5763b7e

Minor addition

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -40,6 +40,11 @@ If the first clone gives you problems (takes too long) you can also:
40
 
41
  Then your model will be inside the downloaded folder.
42
 
 
 
 
 
 
43
  ## Future additions
44
  - [ ] Converting Qwen 2 and Llama 2
45
  - [ ] Adding other compatible Rockchip's SoCs
 
40
 
41
  Then your model will be inside the downloaded folder.
42
 
43
+ ## RKLLM parameters used
44
+ RK3588 **only supports w8a8 quantization**, so that was the selected quantization for ALL models.
45
+ Aside from that, RKLLM toolkit allows for no optimization (0) and optimization (1).
46
+ All models are optimized.
47
+
48
  ## Future additions
49
  - [ ] Converting Qwen 2 and Llama 2
50
  - [ ] Adding other compatible Rockchip's SoCs