jojo1899
/

Llama-2-13b-chat-hf-ov-int4

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-2-13b-chat-hf-ov-int4

Commit History

Improved quantization using Openvino 2024.5.0rc1

0869f09

jojo1899 commited on Nov 7, 2024

Removing older openvino-tokenizers files

0ace247

jojo1899 commited on Nov 6, 2024

Quantized using nncf 2.13.0

397e787
verified

jojo1899 commited on Nov 6, 2024

Added nncf, torch, and transformers package versions

85c391d
verified

jojo1899 commited on Jun 7, 2024

Updated README.md

b7da369
verified

jojo1899 commited on Jun 7, 2024

Initial commit

47a3717
verified

jojo1899 commited on Jun 7, 2024

initial commit

3605700
verified

jojo1899 commited on Jun 7, 2024