ISTA-DASLab
/

Llama-2-7b-AQLM-2Bit-2x8-hf

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Llama-2-7b-AQLM-2Bit-2x8-hf

3 contributors

History: 5 commits

BlackSamorez's picture

Create README.md

45d67dd verified 9 months ago

.gitattributes

1.52 kB

initial commit 10 months ago
README.md

1.47 kB

Create README.md 9 months ago
config.json

2.5 kB

everythin 10 months ago
configuration_llama_aqlm.py

421 Bytes

everythin 10 months ago
modeling_llama_aqlm.py

65.6 kB

better checkpoint 9 months ago
pytorch_model.bin
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch._utils._rebuild_parameter",
- "torch.HalfStorage",
- "torch.CharStorage"
How to fix it?
2.15 GB
LFS

better checkpoint 9 months ago