Edit model card

Corianas/tiny-llama-miniguanaco-1.5T-GGUF

Quantized GGUF model files for tiny-llama-miniguanaco-1.5T from Corianas

Original Model Card:

TinyLLama 1.5T checkpoint trained to answer questions.

f"{'prompt'}\n{'completion'}\n<END>"

No input/output, just question, then newline to begin the answer.

Downloads last month
42
GGUF
Model size
1.1B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples
Inference API (serverless) has been turned off for this model.

Model tree for afrideva/tiny-llama-miniguanaco-1.5T-GGUF

Quantized
(2)
this model

Collection including afrideva/tiny-llama-miniguanaco-1.5T-GGUF