kakinola23 commited on
Commit
bc3bb2f
1 Parent(s): db7f4f1

Model save

Browse files
README.md CHANGED
@@ -1,60 +1,57 @@
1
  ---
2
  base_model: meta-llama/Llama-3.2-3B
3
- library_name: peft
4
- license: llama3.2
5
  tags:
 
6
  - trl
7
  - sft
8
- - generated_from_trainer
9
- model-index:
10
- - name: results
11
- results: []
12
  ---
13
 
14
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
- should probably proofread and complete it, then remove this comment. -->
16
-
17
- # results
18
-
19
- This model is a fine-tuned version of [meta-llama/Llama-3.2-3B](https://huggingface.co/meta-llama/Llama-3.2-3B) on the None dataset.
20
-
21
- ## Model description
22
 
23
- More information needed
 
24
 
25
- ## Intended uses & limitations
26
 
27
- More information needed
 
28
 
29
- ## Training and evaluation data
30
-
31
- More information needed
 
 
32
 
33
  ## Training procedure
34
 
35
- ### Training hyperparameters
 
 
36
 
37
- The following hyperparameters were used during training:
38
- - learning_rate: 0.0002
39
- - train_batch_size: 4
40
- - eval_batch_size: 8
41
- - seed: 42
42
- - gradient_accumulation_steps: 4
43
- - total_train_batch_size: 16
44
- - optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
45
- - lr_scheduler_type: constant
46
- - lr_scheduler_warmup_ratio: 0.03
47
- - num_epochs: 50
48
- - mixed_precision_training: Native AMP
49
 
50
- ### Training results
 
 
 
 
51
 
 
52
 
53
 
54
- ### Framework versions
55
 
56
- - PEFT 0.13.2
57
- - Transformers 4.46.1
58
- - Pytorch 2.5.0+cu121
59
- - Datasets 3.0.2
60
- - Tokenizers 0.20.1
 
 
 
 
 
 
 
 
1
  ---
2
  base_model: meta-llama/Llama-3.2-3B
3
+ library_name: transformers
4
+ model_name: results
5
  tags:
6
+ - generated_from_trainer
7
  - trl
8
  - sft
9
+ licence: license
 
 
 
10
  ---
11
 
12
+ # Model Card for results
 
 
 
 
 
 
 
13
 
14
+ This model is a fine-tuned version of [meta-llama/Llama-3.2-3B](https://huggingface.co/meta-llama/Llama-3.2-3B).
15
+ It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
+ ## Quick start
18
 
19
+ ```python
20
+ from transformers import pipeline
21
 
22
+ question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
23
+ generator = pipeline("text-generation", model="kakinola23/results", device="cuda")
24
+ output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
25
+ print(output["generated_text"])
26
+ ```
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/barkatdanish30-codingbuzz/huggingface/runs/el0ake14)
31
+
32
+ This model was trained with SFT.
33
 
34
+ ### Framework versions
 
 
 
 
 
 
 
 
 
 
 
35
 
36
+ - TRL: 0.12.0
37
+ - Transformers: 4.46.2
38
+ - Pytorch: 2.5.0+cu121
39
+ - Datasets: 3.1.0
40
+ - Tokenizers: 0.20.3
41
 
42
+ ## Citations
43
 
44
 
 
45
 
46
+ Cite TRL as:
47
+
48
+ ```bibtex
49
+ @misc{vonwerra2022trl,
50
+ title = {{TRL: Transformer Reinforcement Learning}},
51
+ author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallouédec},
52
+ year = 2020,
53
+ journal = {GitHub repository},
54
+ publisher = {GitHub},
55
+ howpublished = {\url{https://github.com/huggingface/trl}}
56
+ }
57
+ ```
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a50053f5ced490482cf4f44c8bdb1c13aeac84b54072d24f1d3417fea92621bd
3
  size 73430448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78d7f719a5599fc95870e8c77b5f02aa5d3dbca098fb456b63dd1343154bc44e
3
  size 73430448
runs/Nov11_12-53-50_71ea2e461c0c/events.out.tfevents.1731329649.71ea2e461c0c.7236.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6d765a1420da584bfca02ddc6c9830a3f9d4a15f61f41922f143ee20c1e01c7c
3
- size 5582
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0ecf5e7b1944b1e43c13bc71a360a97baa450e92b218cfb0d8992e38fbf25f3
3
+ size 5930