Size in 4bit ?

by Nicolas-BZRD - opened Apr 10, 2024

Apr 10, 2024

Hey guys, thanks for the sharing.

Do you have the size once the model is quantised in 4 bit ?

Unofficial Mistral Community org Apr 10, 2024

Around ~75GB

Apr 10, 2024

thx !

Nicolas-BZRD changed discussion status to closed Apr 10, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment