|
--- |
|
license: llama2 |
|
library_name: peft |
|
tags: |
|
- generated_from_trainer |
|
base_model: unsloth/llama-3-8b-bnb-4bit |
|
metrics: |
|
- accuracy |
|
model-index: |
|
- name: llama3-qwantz-punchline |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# llama3-qwantz-punchline |
|
|
|
This model is a fine-tuned version of [unsloth/llama-3-8b-bnb-4bit](https://huggingface.co/unsloth/llama-3-8b-bnb-4bit) on an unknown dataset. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.8012 |
|
- Accuracy: 0.7706 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 0.0001 |
|
- train_batch_size: 4 |
|
- eval_batch_size: 4 |
|
- seed: 42 |
|
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
|
- lr_scheduler_type: linear |
|
- num_epochs: 2 |
|
- mixed_precision_training: Native AMP |
|
|
|
### Training results |
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Accuracy | |
|
|:-------------:|:-----:|:----:|:---------------:|:--------:| |
|
| 0.6763 | 1.0 | 300 | 0.7377 | 0.7529 | |
|
| 0.419 | 2.0 | 600 | 0.8012 | 0.7706 | |
|
|
|
``` |
|
Can save 50% of punchlines by discarding 97% of nonsequiturs (cutoff is 99.31640625) |
|
Can save 75% of punchlines by discarding 95% of nonsequiturs (cutoff is 91.6015625) |
|
Can save 90% of punchlines by discarding 77% of nonsequiturs (cutoff is -69.43359375) |
|
Can save 92% of punchlines by discarding 62% of nonsequiturs (cutoff is -85.400390625) |
|
Can save 93% of punchlines by discarding 61% of nonsequiturs (cutoff is -87.109375) |
|
Can save 94% of punchlines by discarding 55% of nonsequiturs (cutoff is -92.28515625) |
|
Can save 95% of punchlines by discarding 52% of nonsequiturs (cutoff is -94.482421875) |
|
Can save 98% of punchlines by discarding 8% of nonsequiturs (cutoff is -99.70703125) |
|
Can save 99% of punchlines by discarding 5% of nonsequiturs (cutoff is -99.8046875) |
|
|
|
yor that says I'm not allowed to name anything ever! [SPEAKER] T-REX [LINE] Hah! Shakespeare's already QUITE the character, believe you me!! ==> nonsequitur: 88.18% |
|
the mayor that says I'm not allowed to name anything ever! [SPEAKER] T-REX [LINE] THAT should finally straighten up some things around here! ==> real: 95.17% |
|
SPEAKER] T-REX [LINE] You're welcome! [SPEAKER] T-REX [LINE] Because Utahraptor, it means that today is the first time in history, in ALL OF ==> nonsequitur: 96.92% |
|
rk. [SPEAKER] T-REX [LINE] You're welcome! [SPEAKER] T-REX [LINE] Now, HERE'S how putting the things in my mouth ties in with existence. . . ==> real: 80.86% |
|
reasing in a closed system is so WRONG. So... NAUGHTY. [SPEAKER] T-REX [LINE] Homecare is when doctors or nurses visit you in your own home! ==> nonsequitur: 99.90% |
|
py decreasing in a closed system is so WRONG. So... NAUGHTY. [SPEAKER] T-REX [LINE] Aw, man!! Am I a dude who gets turned on by descrambling ==> nonsequitur: 55.22% |
|
T-REX [LINE] Oh! Yeah, it was nice. We had "chai" tea. [SPEAKER] UTAHRAPTOR [LINE] And...? [SPEAKER] T-REX [LINE] It's a joke that plays off ==> nonsequitur: 99.32% |
|
EX [LINE] Oh! Yeah, it was nice. We had "chai" tea. [SPEAKER] UTAHRAPTOR [LINE] And...? [SPEAKER] T-REX [LINE] And then we had dinosaur sex! ==> real: 99.61% |
|
ent! [SPEAKER] FUTURE T-REX [LINE] Utahraptor! I'm gonna kiss you so much in ten minutes! [SPEAKER] T-REX [LINE] I was gonna do that anyway! ==> real: 99.95% |
|
oment! [SPEAKER] FUTURE T-REX [LINE] Utahraptor! I'm gonna kiss you so much in ten minutes! [SPEAKER] T-REX [LINE] Um - that, ah, wasn't me. ==> real: 100.00% |
|
end in victory... or in fiery death for us both? FIND OUT IN MY NEXT BOOK! [SPEAKER] T-REX [LINE] It's time to shake things up, T-Rex style! ==> nonsequitur: 96.97% |
|
t end in victory... or in fiery death for us both? FIND OUT IN MY NEXT BOOK! [SPEAKER] T-REX [LINE] The book is called, "A Plane Saved Them, ==> nonsequitur: 85.40% |
|
] NARRATOR [LINE] LATER, A LONG TRAIN RIDE HOME: [SPEAKER] T-REX [LINE] I also vacuum as if nobody's going to get their carpets any cleaner! ==> nonsequitur: 80.57% |
|
[SPEAKER] NARRATOR [LINE] LATER, A LONG TRAIN RIDE HOME: [SPEAKER] T-REX [LINE] "If there was a singular Dickens who had to pee, I would be ==> nonsequitur: 97.95% |
|
with a candle and sang "Happy birthday" to myself, quiet and soft. [SPEAKER] T-REX [LINE] The only downside is that the Dromiceiomimus won't ==> nonsequitur: 78.32% |
|
ce of cake with a candle and sang "Happy birthday" to myself, quiet and soft. [SPEAKER] T-REX [LINE] The waitress gave me the cake for free! ==> real: 99.90% |
|
X [LINE] He probably would! Man! [SPEAKER] T-REX [LINE] Poor Al! [SPEAKER] T-REX [LINE] Dromiceiomimus, do you ever approach something new, ==> nonsequitur: 98.83% |
|
R] T-REX [LINE] He probably would! Man! [SPEAKER] T-REX [LINE] Poor Al! [SPEAKER] T-REX [LINE] I've never felt worse for inventing someone! ==> real: 99.71% |
|
on a helicopter ride. A ghost appears, and when Hamlet high fives him he explodes! Then Denmark explodes. [SPEAKER] T-REX [LINE] I AM MERELY ==> nonsequitur: 97.46% |
|
r ride. A ghost appears, and when Hamlet high fives him he explodes! Then Denmark explodes. [SPEAKER] T-REX [LINE] Later, Ophelia's topless! ==> real: 99.90% |
|
my problems look like vegetables in need of a good steaming! [SPEAKER] T-REX [LINE] I've - [SPEAKER] T-REX [LINE] True stories! FACTS! Want ==> nonsequitur: 98.68% |
|
my problems look like vegetables in need of a good steaming! [SPEAKER] T-REX [LINE] I've - [SPEAKER] T-REX [LINE] I've made worse purchases ==> real: 98.19% |
|
is' causes is your BOWELS becoming PERFORATED so that RAW SEWAGE sloshes around in your belly? [SPEAKER] T-REX [LINE] It's new and exciting! ==> real: 99.51% |
|
is' causes is your BOWELS becoming PERFORATED so that RAW SEWAGE sloshes around in your belly? [SPEAKER] T-REX [LINE] Man, bodies are nasty! ==> real: 99.37% |
|
injured, but they injure who they take care of." [SPEAKER] T-REX [LINE] Yes, really? Someone's name could be FARTNOISE FARTNOISE JUNIOR, and ==> nonsequitur: 99.80% |
|
f the injured, but they injure who they take care of." [SPEAKER] T-REX [LINE] Okay, whatever! My formula is still good DESPITE nurse racism. ==> real: 99.95% |
|
pin will ENTIRELY OVERSHADOW anything I've ever accomplished in my life! [SPEAKER] T-REX [LINE] It TOTALLY works! I just thought that losing ==> nonsequitur: 99.90% |
|
the pin will ENTIRELY OVERSHADOW anything I've ever accomplished in my life! [SPEAKER] T-REX [LINE] No, that - that only makes things worse. ==> real: 99.85% |
|
TOE, turns to the camera in terror, wide-eyed, and screams "Oh GOSSSSSH!!!" [SPEAKER] T-REX [LINE] I got one that was like "I am really sad ==> nonsequitur: 99.56% |
|
to the camera in terror, wide-eyed, and screams "Oh GOSSSSSH!!!" [SPEAKER] T-REX [LINE] Holy crap. There's nothing not to like in my movie. ==> real: 99.85% |
|
BILITY! IF WE WERE ALL FRIENDS, I AM CERTAIN YOU WOULD BE "THE IRRITATING ONE"! [SPEAKER] T-REX [LINE] Maybe you'd all like to come and have ==> nonsequitur: 77.25% |
|
IF WE WERE ALL FRIENDS, I AM CERTAIN YOU WOULD BE "THE IRRITATING ONE"! [SPEAKER] T-REX [LINE] Oh my gosh, Utahraptor! I concede your point! ==> real: 100.00% |
|
i'm trying to write some sonnets here, t-rex! [SPEAKER] T-REX [LINE] HEY SHAKESPEARE! [SPEAKER] T-REX [LINE] It's not that hard, you guys! ==> nonsequitur: 99.02% |
|
trying to write some sonnets here, t-rex! [SPEAKER] T-REX [LINE] HEY SHAKESPEARE! [SPEAKER] T-REX [LINE] I DON'T THINK PEOPLE ACTUALLY USED ==> nonsequitur: 98.78% |
|
rrelevant." He then focused himself on the seriously erotic business of being Hamlet II. [SPEAKER] T-REX [LINE] Debatable! People often talk ==> real: 75.59% |
|
ow irrelevant." He then focused himself on the seriously erotic business of being Hamlet II. [SPEAKER] T-REX [LINE] There! Sex AND politics! ==> real: 94.38% |
|
Secret Mission of Wikipedia! Don't tell anyone, okay? [SPEAKER] T-REX [LINE] Hah! Awesome! [SPEAKER] T-REX [LINE] Imagine if we had a beach ==> nonsequitur: 99.85% |
|
t Mission of Wikipedia! Don't tell anyone, okay? [SPEAKER] T-REX [LINE] Hah! Awesome! [SPEAKER] T-REX [LINE] ...Why didn't they just say so? ==> real: 99.95% |
|
ns but his teeth passed right through brains!! [SPEAKER] UTAHRAPTOR [LINE] Oh yeah? [SPEAKER] T-REX [LINE] I'm tired of movies and plays and ==> nonsequitur: 99.32% |
|
teeth passed right through brains!! [SPEAKER] UTAHRAPTOR [LINE] Oh yeah? [SPEAKER] T-REX [LINE] I would describe him as "pretty frustrated" ==> real: 100.00% |
|
I am loveable and trustworthy and good at conversations! [SPEAKER] T-REX [LINE] ... [SPEAKER] T-REX [LINE] Historically speaking, all I know ==> nonsequitur: 69.97% |
|
loveable and trustworthy and good at conversations! [SPEAKER] T-REX [LINE] ... [SPEAKER] T-REX [LINE] I've had FIVE girlfriends, Utahraptor. ==> real: 99.90% |
|
``` |
|
|
|
### Framework versions |
|
|
|
- PEFT 0.10.0 |
|
- Transformers 4.40.2 |
|
- Pytorch 2.2.1+cu121 |
|
- Datasets 2.19.1 |
|
- Tokenizers 0.19.1 |
