gradientai
/

Llama-3-8B-Instruct-Gradient-1048k

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

michaelfeil commited on Apr 29

Commit

69e6264

•

1 Parent(s): 2ed1903

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -52,6 +52,7 @@ For training data, we generate long contexts by augmenting [SlimPajama](https://
 **Quants**:
 - [GGUF](https://huggingface.co/crusoeai/Llama-3-8B-Instruct-1048k-GGUF)
 ## The Gradient AI Team

 **Quants**:
 - [GGUF](https://huggingface.co/crusoeai/Llama-3-8B-Instruct-1048k-GGUF)
+- [MLX-4bit](https://huggingface.co/mlx-community/Llama-3-8B-Instruct-1048k-4bit)
 ## The Gradient AI Team