Hugging Face's logo

bartowski
/
llama-3-70B-Instruct-abliterated-GGUF

Text Generation
Transformers
GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
1
New discussion

OOM when trying to load the Q8 in Oobabooga (I have 98GB VRAM)

2
#1 opened 4 months ago by AIGUYCONTENT