Hugging Face's logo

juewang
/
deepseek-coder-6.7b-instruct-trt-int4-g64-hf

Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference
8-bit precision
Model card Files Community

No model card

New: Create and edit this model card directly on the website!

Contribute a Model Card
Downloads last month
4
Safetensors
Model size
3.7B params
Tensor type
I64
·
FP16
·
I8
·
Inference API
Text Generation
Examples
Input a message to start chatting with juewang/deepseek-coder-6.7b-instruct-trt-int4-g64-hf.
This model can be loaded on Inference API (serverless).