Can you make a model that can run without quantization on a gpu with only 8g vram?

by win10 - opened Dec 18, 2023

win10

Dec 18, 2023

Can you make a model that can run without quantization on a gpu with only 8g vram?

Owner Dec 18, 2023

maywell changed discussion status to closed Dec 18, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment