inarikami commited on
Commit
540e926
·
verified ·
1 Parent(s): dfefd68

fix yaml desc

Browse files
Files changed (1) hide show
  1. README.md +7 -5
README.md CHANGED
@@ -1,11 +1,13 @@
1
- # DeepSeek V3 - INT4 (TensorRT-LLM)
2
-
3
- This repository provides an INT4-quantized version of the DeepSeek V3 model, suitable for high-speed, memory-efficient inference with TensorRT-LLM.
4
-
5
  ---
 
 
6
  base_model:
7
  - deepseek-ai/DeepSeek-V3
 
8
  ---
 
 
 
9
 
10
 
11
  Model Summary
@@ -36,4 +38,4 @@ trtllm-build --checkpoint_dir /DeepSeek-V3-int4-TensorRT \
36
 
37
  ### Disclaimer:
38
 
39
- This model is a quantized checkpoint intended for research and experimentation with high-performance inference. Use at your own risk and validate outputs for production use-cases.
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
  base_model:
5
  - deepseek-ai/DeepSeek-V3
6
+ pipeline_tag: text-generation
7
  ---
8
+ # DeepSeek V3 - INT4 (TensorRT-LLM)
9
+
10
+ This repository provides an INT4-quantized version of the DeepSeek V3 model, suitable for high-speed, memory-efficient inference with TensorRT-LLM.
11
 
12
 
13
  Model Summary
 
38
 
39
  ### Disclaimer:
40
 
41
+ This model is a quantized checkpoint intended for research and experimentation with high-performance inference. Use at your own risk and validate outputs for production use-cases.