Models
Datasets
Spaces
Posts
Docs
Pricing
Log In
Sign Up

joostinyi-baseten
/

llama_7b_sq0.8_intkv_custom_a_r

Inference Endpoints

Model card Files Files and versions Community

llama_7b_sq0.8_intkv_custom_a_r

1 contributor

History: 2 commits

joostinyi-baseten's picture

joostinyi-baseten

Upload folder using huggingface_hub

6f3bf02 12 months ago

.gitattributes

1.59 kB

Upload folder using huggingface_hub 12 months ago
config.json

1.32 kB

Upload folder using huggingface_hub 12 months ago
llama_float16_tp1_rank0.engine

7.01 GB
LFS

Upload folder using huggingface_hub 12 months ago
model.cache

88 kB

Upload folder using huggingface_hub 12 months ago