Llama-3.2-3B-o1 / README.md
Pinkstack's picture
Update README.md
fd407ba verified
metadata
base_model: unsloth/llama-3.2-3b-instruct-bnb-4bit
tags:
  - text-generation-inference
  - transformers
  - unsloth
  - llama
  - gguf
license: apache-2.0
language:
  - en
datasets:
  - gghfez/QwQ-LongCoT-130K-cleaned
pipeline_tag: text-generation

I highly recommend you to use our flagship 3B model instead: https://huggingface.co/Pinkstack/PARM-V2-QwQ-Qwen-2.5-o1-3B-GGUF <- this model has generally better performance and is higher quality.

Uploaded model

Further trained Llama 3.2 3B with enhanced reasoning, aimed to mimic deepseek r1 quality.

Trained with Nvidia Tesla T4

This is the first model we've trained it may have abnormalities, Phi 3.5 soon.

  • Developed by: PinkStack
  • License: apache-2.0
  • Finetuned from model : unsloth/llama-3.2-3b-instruct-bnb-4bit

This llama model was trained using Unsloth and Huggingface's TRL library.