swap-uniba
/

LLaMAntino-2-chat-7b-hf-UltraChat-ITA

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Ask for int4 quantized version in the gguf format

#1

by Fede90 - opened Jan 18

Fede90

Jan 18

Is it possible to download the int4 quantized version in the gguf format? thanks

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment