second-state

/

Mistral-Nemo-Instruct-2407-GGUF

like 63

Follow

Second State 90

tried
model = MistralForSequenceClassification.from_pretrained(
"second-state/Mistral-Nemo-Instruct-2407-Q5_K_M.gguf",
num_labels=3,
torch_dtype=torch.float16,
device_map="auto",
)
but failed