CoreML conversion of Llama-3.2-1B-Instruct with a 512 context length. Optimized for Apple Neural Engine.

Use this CLI to download and run inference. macOS 14 (Sonoma) is required.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for smpanaro/Llama-3.2-1B-Instruct-CoreML

Finetuned
(294)
this model

Collection including smpanaro/Llama-3.2-1B-Instruct-CoreML