phatjk
/

vietcuna-7b-v3-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

phatjk commited on Nov 30, 2023

Commit

c948833

•

1 Parent(s): 7111723

Create README.md

Files changed (1) hide show

README.md +4 -0

README.md ADDED Viewed

	@@ -0,0 +1,4 @@

+---
+pipeline_tag: text-generation
+---
+ "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM"