ModelCloud
/

DeepSeek-V2-Lite-gptq-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

DeepSeek-V2-Lite-gptq-4bit

2 contributors

History: 3 commits

lrl-modelcloud's picture

5030786bb6855d6aab3c07c44e8c266e67becc9f1fa2c28b243bb9f6dbec7179

087a59a verified 5 months ago

.gitattributes

1.52 kB

initial commit 5 months ago
config.json

1.99 kB

5030786bb6855d6aab3c07c44e8c266e67becc9f1fa2c28b243bb9f6dbec7179 5 months ago
configuration_deepseek.py

10.3 kB

5030786bb6855d6aab3c07c44e8c266e67becc9f1fa2c28b243bb9f6dbec7179 5 months ago
model.safetensors

8.83 GB
LFS

5041bb7f45e7e65d3be40a7a672e92ee16b3e439bbb307165c8c5cab6fcc4d8c 5 months ago
modeling_deepseek.py

78.7 kB

5030786bb6855d6aab3c07c44e8c266e67becc9f1fa2c28b243bb9f6dbec7179 5 months ago
quantize_config.json

340 Bytes

5030786bb6855d6aab3c07c44e8c266e67becc9f1fa2c28b243bb9f6dbec7179 5 months ago
special_tokens_map.json

482 Bytes

5030786bb6855d6aab3c07c44e8c266e67becc9f1fa2c28b243bb9f6dbec7179 5 months ago
tokenizer.json

4.61 MB

5030786bb6855d6aab3c07c44e8c266e67becc9f1fa2c28b243bb9f6dbec7179 5 months ago
tokenizer_config.json

1.34 kB

5030786bb6855d6aab3c07c44e8c266e67becc9f1fa2c28b243bb9f6dbec7179 5 months ago