ISTA-DASLab
/

Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (0)

it run on colab t4

#5 opened 3 months ago by

Need example of model usage

#4 opened 6 months ago by

gguf

#3 opened 6 months ago by

VLLM error

#2 opened 6 months ago by

The quant doesn't load in vLLM / Aphrodite Engine

#1 opened 6 months ago by