Hugging Face's logo

c01zaut
/
SystemGemma2-2b-it-rk3588-1.1.2

Text Generation
Transformers
Safetensors
gemma2
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
c01zaut commited on
Commit
a2bbf91
·
verified ·
1 Parent(s): 2ce843d

Upload folder using huggingface_hub

Browse files
Files changed (20) hide show
  1. .gitattributes +12 -0
  2. README.md +1 -1
  3. SystemGemma2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-0.0.rkllm +1 -1
  4. SystemGemma2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-0.5.rkllm +1 -1
  5. SystemGemma2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm +1 -1
  6. SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm +1 -1
  7. SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm +1 -1
  8. SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm +1 -1
  9. SystemGemma2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  10. SystemGemma2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  11. SystemGemma2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  12. SystemGemma2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  13. SystemGemma2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  14. SystemGemma2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm +3 -0
  15. SystemGemma2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  16. SystemGemma2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  17. SystemGemma2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  18. SystemGemma2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  19. SystemGemma2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  20. SystemGemma2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm +3 -0
.gitattributes CHANGED
@@ -40,3 +40,15 @@ SystemGemma2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs
40
  SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
41
  SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
42
  SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
40
  SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
41
  SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
42
  SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
43
+ SystemGemma2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
44
+ SystemGemma2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
45
+ SystemGemma2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
46
+ SystemGemma2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
47
+ SystemGemma2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
48
+ SystemGemma2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
49
+ SystemGemma2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
50
+ SystemGemma2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
51
+ SystemGemma2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
52
+ SystemGemma2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
53
+ SystemGemma2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
54
+ SystemGemma2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -13,7 +13,7 @@ extra_gated_button_content: Acknowledge license
13
  ---
14
  # SystemGemma2-2b-it-RK3588-1.1.2
15
 
16
- This version of SystemGemma2-2b-it has been converted to run on the RK3588 NPU using ['w8a8'] quantization.
17
  This model has been optimized with the following LoRA:
18
 
19
  Compatible with RKLLM version: 1.1.2
 
13
  ---
14
  # SystemGemma2-2b-it-RK3588-1.1.2
15
 
16
+ This version of SystemGemma2-2b-it has been converted to run on the RK3588 NPU using ['w8a8', 'w8a8_g128', 'w8a8_g256', 'w8a8_g512'] quantization.
17
  This model has been optimized with the following LoRA:
18
 
19
  Compatible with RKLLM version: 1.1.2
SystemGemma2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-0.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74ee57fcda6468cb39f8650112ab2e682e733264cdb8df7254c6524f1f3597a5
3
  size 3820727588
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffcc2db312d53cffb941169c795e153d48367c5eb19e7ebbff649f1c19ac7601
3
  size 3820727588
SystemGemma2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-0.5.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74ee57fcda6468cb39f8650112ab2e682e733264cdb8df7254c6524f1f3597a5
3
  size 3820727588
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffcc2db312d53cffb941169c795e153d48367c5eb19e7ebbff649f1c19ac7601
3
  size 3820727588
SystemGemma2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74ee57fcda6468cb39f8650112ab2e682e733264cdb8df7254c6524f1f3597a5
3
  size 3820727588
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffcc2db312d53cffb941169c795e153d48367c5eb19e7ebbff649f1c19ac7601
3
  size 3820727588
SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7d8e6e14cb6b5f0a44295fcc14f17a62b5a79a32a182d68e843c1f0f87c352dd
3
  size 3820727588
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e88778114491202011472888ff20a70f67a1d589d087d1986793efee8d5a245f
3
  size 3820727588
SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7d8e6e14cb6b5f0a44295fcc14f17a62b5a79a32a182d68e843c1f0f87c352dd
3
  size 3820727588
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e88778114491202011472888ff20a70f67a1d589d087d1986793efee8d5a245f
3
  size 3820727588
SystemGemma2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7d8e6e14cb6b5f0a44295fcc14f17a62b5a79a32a182d68e843c1f0f87c352dd
3
  size 3820727588
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e88778114491202011472888ff20a70f67a1d589d087d1986793efee8d5a245f
3
  size 3820727588
SystemGemma2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b65582c3c42ae7a269d50b699720430cd96ca0312dbe2ac2ed27c8e898eec3fb
3
+ size 4010360044
SystemGemma2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b65582c3c42ae7a269d50b699720430cd96ca0312dbe2ac2ed27c8e898eec3fb
3
+ size 4010360044
SystemGemma2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b65582c3c42ae7a269d50b699720430cd96ca0312dbe2ac2ed27c8e898eec3fb
3
+ size 4010360044
SystemGemma2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c87338dc5f4e956be101e7c97262e2abab15bd2f26cb7b95663c8b93d5b4efb4
3
+ size 3974081788
SystemGemma2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c87338dc5f4e956be101e7c97262e2abab15bd2f26cb7b95663c8b93d5b4efb4
3
+ size 3974081788
SystemGemma2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c87338dc5f4e956be101e7c97262e2abab15bd2f26cb7b95663c8b93d5b4efb4
3
+ size 3974081788
SystemGemma2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a1c70bde37e3da299dd7cd4f5f4674372632405c32b1469815553a39a3e85ab5
3
+ size 3911797180
SystemGemma2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a1c70bde37e3da299dd7cd4f5f4674372632405c32b1469815553a39a3e85ab5
3
+ size 3911797180
SystemGemma2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a1c70bde37e3da299dd7cd4f5f4674372632405c32b1469815553a39a3e85ab5
3
+ size 3911797180
SystemGemma2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5fd27426cd4bfb4dc6b13625822fe811387b3ea7be06ce78afcea1b5092802d
3
+ size 3894717724
SystemGemma2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5fd27426cd4bfb4dc6b13625822fe811387b3ea7be06ce78afcea1b5092802d
3
+ size 3894717724
SystemGemma2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5fd27426cd4bfb4dc6b13625822fe811387b3ea7be06ce78afcea1b5092802d
3
+ size 3894717724