| base_model: meta-llama/Llama-3.2-3B-Instruct | |
| datasets: | |
| - tatsu-lab/alpaca | |
| language: en | |
| tags: | |
| - torchtune | |
| # my_cool_model | |
| This model is a finetuned version of [meta-llama/Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct) on the [tatsu-lab/alpaca](https://huggingface.co/tatsu-lab/alpaca) dataset. | |
| # Model description | |
| More information needed | |
| # Training and evaluation results | |
| More information needed | |
| # Training procedure | |
| This model was trained using the [torchtune](https://github.com/pytorch/torchtune) library using the following command: | |
| ```bash | |
| ppo_full_finetune_single_device.py \ | |
| --config ./target/7B_full_ppo_low_memory_single_device.yaml \ | |
| device=cuda \ | |
| metric_logger._component_=torchtune.utils.metric_logging.WandBLogger \ | |
| metric_logger.project=torchtune_ppo \ | |
| forward_batch_size=2 \ | |
| batch_size=64 \ | |
| ppo_batch_size=32 \ | |
| gradient_accumulation_steps=16 \ | |
| compile=True \ | |
| optimizer._component_=bitsandbytes.optim.PagedAdamW \ | |
| optimizer.lr=3e-4 | |
| ``` | |
| # Framework versions | |
| - torchtune | |
| - torchao 0.5.0 | |
| - datasets 2.20.0 | |
| - sentencepiece 0.2.0 | |