README.md

---
base_model: chargoddard/SmolLlamix-8x101M
datasets:
- togethercomputer/RedPajama-Data-1T-Sample
inference: false
language:
- en
license: apache-2.0
model_creator: chargoddard
model_name: SmolLlamix-8x101M
pipeline_tag: text-generation
quantized_by: afrideva
tags:
- llama
- gguf
- ggml
- quantized
- q2_k
- q3_k_m
- q4_k_m
- q5_k_m
- q6_k
- q8_0
---
# chargoddard/SmolLlamix-8x101M-GGUF

Quantized GGUF model files for [SmolLlamix-8x101M](https://huggingface.co/chargoddard/SmolLlamix-8x101M) from [chargoddard](https://huggingface.co/chargoddard)


| Name | Quant method | Size |
| ---- | ---- | ---- |
| [smolllamix-8x101m.fp16.gguf](https://huggingface.co/afrideva/SmolLlamix-8x101M-GGUF/resolve/main/smolllamix-8x101m.fp16.gguf) | fp16 | 798.87 MB  |
| [smolllamix-8x101m.q2_k.gguf](https://huggingface.co/afrideva/SmolLlamix-8x101M-GGUF/resolve/main/smolllamix-8x101m.q2_k.gguf) | q2_k | 146.83 MB  |
| [smolllamix-8x101m.q3_k_m.gguf](https://huggingface.co/afrideva/SmolLlamix-8x101M-GGUF/resolve/main/smolllamix-8x101m.q3_k_m.gguf) | q3_k_m | 184.67 MB  |
| [smolllamix-8x101m.q4_k_m.gguf](https://huggingface.co/afrideva/SmolLlamix-8x101M-GGUF/resolve/main/smolllamix-8x101m.q4_k_m.gguf) | q4_k_m | 233.54 MB  |
| [smolllamix-8x101m.q5_k_m.gguf](https://huggingface.co/afrideva/SmolLlamix-8x101M-GGUF/resolve/main/smolllamix-8x101m.q5_k_m.gguf) | q5_k_m | 279.97 MB  |
| [smolllamix-8x101m.q6_k.gguf](https://huggingface.co/afrideva/SmolLlamix-8x101M-GGUF/resolve/main/smolllamix-8x101m.q6_k.gguf) | q6_k | 329.31 MB  |
| [smolllamix-8x101m.q8_0.gguf](https://huggingface.co/afrideva/SmolLlamix-8x101M-GGUF/resolve/main/smolllamix-8x101m.q8_0.gguf) | q8_0 | 425.26 MB  |



## Original Model Card:
This is eight copies of [BEE-spoke-data/smol_llama-101M-GQA](https://huggingface.co/BEE-spoke-data/smol_llama-101M-GQA) ensembled into a Mixtral model, then trained very briefly on a small subset of RedPajama. Mostly just an experiment to demonstrate that training it works at all.

It's very, very smart. Probably the smartest model ever made. Better than GPT-5. See its thoughts on the internet:

> In a world where the internet is so much more than a web browser, it's also very important to have a good understanding of how the internet works.
> The first thing we need to do is to understand what the internet looks like and what the future looks like. We can use the internet to look at the internet's history, but we don't want to go into detail about the history of the internet. The internet was created by the internet's history, which is often called the history of the internet. It was originally developed as a way for people to learn about the internet, but it wasn't until the 1960s that the internet became a place to work. Today, the internet is used in many ways, from the internet's history to the internet itself.