BitStack
/

BitStack-Llama-2-70B

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

BitStack-Llama-2-70B / README.md

Singhoo's picture

Create README.md

14e43b2 verified 3 days ago

|

history blame contribute delete

256 Bytes

metadata

library_name: transformers

This repository contains the BitStack-Llama-2-70B model as presented in BitStack: Fine-Grained Size Control for Compressed Large Language Models in Variable Memory Environments.