Nekuromento/ToolACE-8B-Q8_0-GGUF · ToolACE-8B-Q8

stueng

Oct 21

When trying to use langchain with this model and Ollama it returns the following:

ResponseError: hf.co/Nekuromento/ToolACE-8B-Q8_0-GGUF does not support tools

Any ideas?

Owner Oct 21

Ollama tool call support requires model chat template to refer to .ToolCalls property (check original Llama 3.2 ollama chat template for an example - https://ollama.com/library/llama3.2/blobs/966de95ca8a6)
You can find examples of tool call formatting on the model card or in the dataset provided by model authors - https://huggingface.co/datasets/Team-ACE/ToolACE

I'm just hosting the quantized version, any questions about the original model should be asked from the model authors or ollama community directly

Nekuromento changed discussion status to closed Oct 21