File size: 9,182 Bytes
1b4dba1 8cfeac0 1b4dba1 8cfeac0 1b4dba1 8cfeac0 1b4dba1 8cfeac0 1b4dba1 89fefb0 1b4dba1 8cfeac0 1b4dba1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 |
---
license: llama2
library_name: peft
tags:
- generated_from_trainer
base_model: unsloth/llama-3-8b-bnb-4bit
metrics:
- accuracy
model-index:
- name: llama3-qwantz-punchline
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# llama3-qwantz-punchline
This model is a fine-tuned version of [unsloth/llama-3-8b-bnb-4bit](https://huggingface.co/unsloth/llama-3-8b-bnb-4bit) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.8012
- Accuracy: 0.7706
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 2
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
| 0.6763 | 1.0 | 300 | 0.7377 | 0.7529 |
| 0.419 | 2.0 | 600 | 0.8012 | 0.7706 |
```
Can save 50% of punchlines by discarding 97% of nonsequiturs (cutoff is 99.31640625)
Can save 75% of punchlines by discarding 95% of nonsequiturs (cutoff is 91.6015625)
Can save 90% of punchlines by discarding 77% of nonsequiturs (cutoff is -69.43359375)
Can save 92% of punchlines by discarding 62% of nonsequiturs (cutoff is -85.400390625)
Can save 93% of punchlines by discarding 61% of nonsequiturs (cutoff is -87.109375)
Can save 94% of punchlines by discarding 55% of nonsequiturs (cutoff is -92.28515625)
Can save 95% of punchlines by discarding 52% of nonsequiturs (cutoff is -94.482421875)
Can save 98% of punchlines by discarding 8% of nonsequiturs (cutoff is -99.70703125)
Can save 99% of punchlines by discarding 5% of nonsequiturs (cutoff is -99.8046875)
yor that says I'm not allowed to name anything ever! [SPEAKER] T-REX [LINE] Hah! Shakespeare's already QUITE the character, believe you me!! ==> nonsequitur: 88.18%
the mayor that says I'm not allowed to name anything ever! [SPEAKER] T-REX [LINE] THAT should finally straighten up some things around here! ==> real: 95.17%
SPEAKER] T-REX [LINE] You're welcome! [SPEAKER] T-REX [LINE] Because Utahraptor, it means that today is the first time in history, in ALL OF ==> nonsequitur: 96.92%
rk. [SPEAKER] T-REX [LINE] You're welcome! [SPEAKER] T-REX [LINE] Now, HERE'S how putting the things in my mouth ties in with existence. . . ==> real: 80.86%
reasing in a closed system is so WRONG. So... NAUGHTY. [SPEAKER] T-REX [LINE] Homecare is when doctors or nurses visit you in your own home! ==> nonsequitur: 99.90%
py decreasing in a closed system is so WRONG. So... NAUGHTY. [SPEAKER] T-REX [LINE] Aw, man!! Am I a dude who gets turned on by descrambling ==> nonsequitur: 55.22%
T-REX [LINE] Oh! Yeah, it was nice. We had "chai" tea. [SPEAKER] UTAHRAPTOR [LINE] And...? [SPEAKER] T-REX [LINE] It's a joke that plays off ==> nonsequitur: 99.32%
EX [LINE] Oh! Yeah, it was nice. We had "chai" tea. [SPEAKER] UTAHRAPTOR [LINE] And...? [SPEAKER] T-REX [LINE] And then we had dinosaur sex! ==> real: 99.61%
ent! [SPEAKER] FUTURE T-REX [LINE] Utahraptor! I'm gonna kiss you so much in ten minutes! [SPEAKER] T-REX [LINE] I was gonna do that anyway! ==> real: 99.95%
oment! [SPEAKER] FUTURE T-REX [LINE] Utahraptor! I'm gonna kiss you so much in ten minutes! [SPEAKER] T-REX [LINE] Um - that, ah, wasn't me. ==> real: 100.00%
end in victory... or in fiery death for us both? FIND OUT IN MY NEXT BOOK! [SPEAKER] T-REX [LINE] It's time to shake things up, T-Rex style! ==> nonsequitur: 96.97%
t end in victory... or in fiery death for us both? FIND OUT IN MY NEXT BOOK! [SPEAKER] T-REX [LINE] The book is called, "A Plane Saved Them, ==> nonsequitur: 85.40%
] NARRATOR [LINE] LATER, A LONG TRAIN RIDE HOME: [SPEAKER] T-REX [LINE] I also vacuum as if nobody's going to get their carpets any cleaner! ==> nonsequitur: 80.57%
[SPEAKER] NARRATOR [LINE] LATER, A LONG TRAIN RIDE HOME: [SPEAKER] T-REX [LINE] "If there was a singular Dickens who had to pee, I would be ==> nonsequitur: 97.95%
with a candle and sang "Happy birthday" to myself, quiet and soft. [SPEAKER] T-REX [LINE] The only downside is that the Dromiceiomimus won't ==> nonsequitur: 78.32%
ce of cake with a candle and sang "Happy birthday" to myself, quiet and soft. [SPEAKER] T-REX [LINE] The waitress gave me the cake for free! ==> real: 99.90%
X [LINE] He probably would! Man! [SPEAKER] T-REX [LINE] Poor Al! [SPEAKER] T-REX [LINE] Dromiceiomimus, do you ever approach something new, ==> nonsequitur: 98.83%
R] T-REX [LINE] He probably would! Man! [SPEAKER] T-REX [LINE] Poor Al! [SPEAKER] T-REX [LINE] I've never felt worse for inventing someone! ==> real: 99.71%
on a helicopter ride. A ghost appears, and when Hamlet high fives him he explodes! Then Denmark explodes. [SPEAKER] T-REX [LINE] I AM MERELY ==> nonsequitur: 97.46%
r ride. A ghost appears, and when Hamlet high fives him he explodes! Then Denmark explodes. [SPEAKER] T-REX [LINE] Later, Ophelia's topless! ==> real: 99.90%
my problems look like vegetables in need of a good steaming! [SPEAKER] T-REX [LINE] I've - [SPEAKER] T-REX [LINE] True stories! FACTS! Want ==> nonsequitur: 98.68%
my problems look like vegetables in need of a good steaming! [SPEAKER] T-REX [LINE] I've - [SPEAKER] T-REX [LINE] I've made worse purchases ==> real: 98.19%
is' causes is your BOWELS becoming PERFORATED so that RAW SEWAGE sloshes around in your belly? [SPEAKER] T-REX [LINE] It's new and exciting! ==> real: 99.51%
is' causes is your BOWELS becoming PERFORATED so that RAW SEWAGE sloshes around in your belly? [SPEAKER] T-REX [LINE] Man, bodies are nasty! ==> real: 99.37%
injured, but they injure who they take care of." [SPEAKER] T-REX [LINE] Yes, really? Someone's name could be FARTNOISE FARTNOISE JUNIOR, and ==> nonsequitur: 99.80%
f the injured, but they injure who they take care of." [SPEAKER] T-REX [LINE] Okay, whatever! My formula is still good DESPITE nurse racism. ==> real: 99.95%
pin will ENTIRELY OVERSHADOW anything I've ever accomplished in my life! [SPEAKER] T-REX [LINE] It TOTALLY works! I just thought that losing ==> nonsequitur: 99.90%
the pin will ENTIRELY OVERSHADOW anything I've ever accomplished in my life! [SPEAKER] T-REX [LINE] No, that - that only makes things worse. ==> real: 99.85%
TOE, turns to the camera in terror, wide-eyed, and screams "Oh GOSSSSSH!!!" [SPEAKER] T-REX [LINE] I got one that was like "I am really sad ==> nonsequitur: 99.56%
to the camera in terror, wide-eyed, and screams "Oh GOSSSSSH!!!" [SPEAKER] T-REX [LINE] Holy crap. There's nothing not to like in my movie. ==> real: 99.85%
BILITY! IF WE WERE ALL FRIENDS, I AM CERTAIN YOU WOULD BE "THE IRRITATING ONE"! [SPEAKER] T-REX [LINE] Maybe you'd all like to come and have ==> nonsequitur: 77.25%
IF WE WERE ALL FRIENDS, I AM CERTAIN YOU WOULD BE "THE IRRITATING ONE"! [SPEAKER] T-REX [LINE] Oh my gosh, Utahraptor! I concede your point! ==> real: 100.00%
i'm trying to write some sonnets here, t-rex! [SPEAKER] T-REX [LINE] HEY SHAKESPEARE! [SPEAKER] T-REX [LINE] It's not that hard, you guys! ==> nonsequitur: 99.02%
trying to write some sonnets here, t-rex! [SPEAKER] T-REX [LINE] HEY SHAKESPEARE! [SPEAKER] T-REX [LINE] I DON'T THINK PEOPLE ACTUALLY USED ==> nonsequitur: 98.78%
rrelevant." He then focused himself on the seriously erotic business of being Hamlet II. [SPEAKER] T-REX [LINE] Debatable! People often talk ==> real: 75.59%
ow irrelevant." He then focused himself on the seriously erotic business of being Hamlet II. [SPEAKER] T-REX [LINE] There! Sex AND politics! ==> real: 94.38%
Secret Mission of Wikipedia! Don't tell anyone, okay? [SPEAKER] T-REX [LINE] Hah! Awesome! [SPEAKER] T-REX [LINE] Imagine if we had a beach ==> nonsequitur: 99.85%
t Mission of Wikipedia! Don't tell anyone, okay? [SPEAKER] T-REX [LINE] Hah! Awesome! [SPEAKER] T-REX [LINE] ...Why didn't they just say so? ==> real: 99.95%
ns but his teeth passed right through brains!! [SPEAKER] UTAHRAPTOR [LINE] Oh yeah? [SPEAKER] T-REX [LINE] I'm tired of movies and plays and ==> nonsequitur: 99.32%
teeth passed right through brains!! [SPEAKER] UTAHRAPTOR [LINE] Oh yeah? [SPEAKER] T-REX [LINE] I would describe him as "pretty frustrated" ==> real: 100.00%
I am loveable and trustworthy and good at conversations! [SPEAKER] T-REX [LINE] ... [SPEAKER] T-REX [LINE] Historically speaking, all I know ==> nonsequitur: 69.97%
loveable and trustworthy and good at conversations! [SPEAKER] T-REX [LINE] ... [SPEAKER] T-REX [LINE] I've had FIVE girlfriends, Utahraptor. ==> real: 99.90%
```
### Framework versions
- PEFT 0.10.0
- Transformers 4.40.2
- Pytorch 2.2.1+cu121
- Datasets 2.19.1
- Tokenizers 0.19.1 |