Overview

The Phi-3, state-of-the-art open model trained with the Phi-3 datasets that includes both synthetic data and the filtered publicly available websites data with a focus on high-quality and reasoning dense properties. The model belongs to the Phi-3 family with the 4B, 7B version in two variants 8K and 128K which is the context length (in tokens) that it can support.

Variants

No Variant Cortex CLI command
1 mini-onnx cortex run phi3:mini-onnx
2 mini-gguf cortex run phi3:mini-gguf
3 medium-gguf cortex run phi3:medium-gguf
4 medium-onnx cortex run phi3:medium-onnx

Use it with Jan (UI)

  1. Install Jan using Quickstart
  2. Use in Jan model Hub:
    cortexso/phi3
    

Use it with Cortex (CLI)

  1. Install Cortex using Quickstart
  2. Run the model with command:
    cortex run phi3
    

Credits

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Collection including cortexso/phi3