---
library_name: setfit
tags:
- setfit
- sentence-transformers
- text-classification
- generated_from_setfit_trainer
metrics:
- accuracy
widget:
- text: so the representative presentative that i talked to a nine o'clock this morning
but it said that they were gonna call the customer service my service or whatever
that they were gonna call to to see if they dispute it and i didn't get a call
back bags i'm a mother of three kids i worked were two job i can't have a phone
that that's not on and i don't have the money the money to pay a hundred and fifty
six eighty six dollars you guys want me to pay right now it's restore my service
- text: i understand kelly yes let me send you a little bit about be a moment okay
is is that the pin number that you have the four days four digits that you have
with us is
- text: yeah 'cause that that's that's really that's ridiculous you know that's ridiculous
for her to do that i like i have you know all the time in the world okay all right
okay okay no i got my card no cathy she asked me for my last time and i did not
have it i'm
- text: ma'am uh thanks for holding for holding by the way everything upon checking
i'm checking here a record ma'am aah for your for your current a hot spot you
said you said you still have twenty gigabytes left
- text: and then when i asked i didn't even get to speak to the supervisor provider
i just got hung up on
pipeline_tag: text-classification
inference: true
base_model: sentence-transformers/all-mpnet-base-v2
model-index:
- name: SetFit with sentence-transformers/all-mpnet-base-v2
results:
- task:
type: text-classification
name: Text Classification
dataset:
name: Unknown
type: unknown
split: test
metrics:
- type: accuracy
value: 0.5463414634146342
name: Accuracy
---
# SetFit with sentence-transformers/all-mpnet-base-v2
This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [sentence-transformers/all-mpnet-base-v2](https://huggingface.co/sentence-transformers/all-mpnet-base-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
The model has been trained using an efficient few-shot learning technique that involves:
1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning.
2. Training a classification head with features from the fine-tuned Sentence Transformer.
## Model Details
### Model Description
- **Model Type:** SetFit
- **Sentence Transformer body:** [sentence-transformers/all-mpnet-base-v2](https://huggingface.co/sentence-transformers/all-mpnet-base-v2)
- **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
- **Maximum Sequence Length:** 384 tokens
- **Number of Classes:** 64 classes
### Model Sources
- **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit)
- **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
### Model Labels
| Label | Examples |
|:------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| 0 | - "yeah and in case you you forget it's actually future date your data so that the one aah you know you know when the bill cycle comes you would just need to pay the the amount of the new of the new plan and you should be good to go"
- "you are eligible for is four one for one upright discount if you want to have once you have a cell phone for free you can uh bring it bring a number from in our account our company explode in verizon i'm i'm sorry it's closed exploding an a t and t"
- "okay so i'm gonna look into look into this of an s that i'll just have have to check in our system if the phone is right one is already eligible for the unlock code okay i'll just have to place you on hold for a minute or two to i'll gonna get right back to you just don't hang up all right all right so"
|
| 20 | - 'hmm hmm alright alright just a moment alright great like rechecking further as of you will be checking your e b b b alright so for your your e bebe this will be applied to your to your account on the twenty third third of august yet in the amount of fifty dollars dollars so currently aah for your because your cycle has has started so your autopay has they have taken an amount of seventy one twenty one dollars for your bill now when when that fifty dollar will come in that will be will be charged to the next billing so on so on your next billing so your your aah billed you would only be twenty one ninety one dollars'
- 'will be charged'
- "thank you right right so while i'm pulling up your account here like the like to tell you about aah autopay so for so for this one here autopay is actually an auto an auto payment in which aah they they uh we take the aah payment on and on your card a day before your due date due date so where this one here upon checking here checking use your next two days is on the sixth of september number which means that your card will be will be charged on the fifth of the number and and on the fourth you will actually be texted and i'll be reminded that our system system we'll take the payment on the card a baby a day before the due date okay"
|
| 11 | - 'shit sorry can you sorry can you say that one more time'
- 'oh bitch pay'
- 'moron'
|
| 16 | - 'i was not trying to rush you into a decision'
- 'understand your concern'
- 'your concern is valid'
|
| 35 | - "aah uh okay if ever though aah aah you decide to aah get a new a new phone you're eligible for this time that aah the phones from our cricket store and from our website website aah just get a quick a cricket phone to make sure that we can really get we guarantee that are hot spot will work on it you can aah get discounted cricket phone the phones okay"
- "able to have it replaced for these um usage of a year here so since you do have your a device we simply been activated that you're actually currently um eligible for the warranty"
- 'aah okay i okay aah yeah sure um yes um peggy take your account is eligible for um which bridge pay'
|
| 21 | - 'thank you would you mind if i can add not going to ask to put you on hold for a manager okay'
- 'thank you the four digit pin under your account'
- 'thank you what is the what is the four digit pin on the trip that account'
|
| 46 | - "just wanna make sure that sure the seat like to get you an answer to see if it's maybe just something just something in the maintenance because if"
- 'yes sir thank you so much for making your bill your payment that we already have receive what happened you did you did you receive the message on for me sign in your end and just to make sure'
- "okay so you're so you're trying to process on the i v r on the automated system which system"
|
| 47 | - 'network is not stable'
- "can't connect"
- 'drop my call'
|
| 6 | - "i'm sorry is that and emelia"
- 'i d i do understand you let me go ahead and check your information here on your phone okay'
- "i see i see right now oh i got something here thing here already i noticed it by the way let me assist you with since you with this i'm sorry that happened but we'll see what's going on going on i get an account and get the name of calvin birth been burns west"
|
| 51 | - "hmm hmm hmm hmm i can barely hear you sir i'm sorry"
- "i can't hear you"
- 'no i say that again'
|
| 27 | - 'oh i understand and yes i can definitely assist you with be doing that assist me so can i can i please have your phone number'
- "if you're having having a hard time to do it on your phone uh to call with me with me then you can just go ahead and aah visit a visit at the store and they can actually assist you with and even they can go ahead and uh you know uh click on it with uh forget pass got password they're using your device and that's and that's the best option for you um to call if you're having have the option to do"
- "thanks for calling to try to me destination my name is that where it's how can i help you"
|
| 19 | - 'buy cable protector'
- 'get screen protection'
- 'need cable protector'
|
| 62 | - 'arsehole'
- 'fool'
- 'bastard'
|
| 12 | - "i just want i just want the number it's this not not a transfer anything for a new phone it's phone it's the same phone"
- 'when i got i got the other new phones on'
- 'aah yeah do you need to you need to put my new aah i m e i number in from in for my new phone'
|
| 13 | - 'web site was confusing'
- 'placeholder'
- 'could not find app'
|
| 56 | - "yes yesterday yesterday i called to add her mobile hot spot to my phone and then phone and it isn't working"
- "remember to sent the customer for their business hi frank uh this is aah meredith there it is i was calling aah to see to see what we can do about my cell phone i got it hmm uh maybe a week or two ago i mean i and it's coming up restricted or private five it when i called people it's not even showing my number my number and i know it's nothing in my phone in my phone or if it is i haven't learned how to fix it"
- "uh huh oh shit i'm by the little boy almost does it is there no knowing some come up come up please stay on the line yes that's what i need my gas for for people that so have no z four for people in the philippines they don't they don't know what they don't know what do you then hit no other information phone number nothing to do all that yeah with the mail when i called what other m b a"
|
| 31 | - "yes of course aah she can just you know really visa i mean visit our website cause it round while dot com and you know see a c a check for this phone and you can just and you can just you know um select the option that and that can customer and i'm upgrading my phone phone and just add to the card and you know you know it will continuously have have it place you'll just need to put your bill you know billing address that you're info so that you could have you can have it successfully"
- 'yeah yeah you can go to the store uh by twenty the twenty first'
- "gigabytes okay okay she's aah just still work still working on it by the way if you have any have any increase you can also visit our website and you can and you can make a payment online are our cricket up for you to avoid for four dollars of assistance fee"
|
| 49 | - "let me double check hold check hold on um we actually actually have as well the samsung galaxy i'll see a twelve for or aah one hundred nine dollars and ninety nine cents nine cents"
- 'thank you very much let me go ahead and process the payment the payment for just allow me one moment'
- 'okay so let me see okay mister and what you say you were trying to ask to activate a new device right'
|
| 15 | - "all that's all okay thank you so much how much glad i was able to help out online lucky your device your device once again the supervisor from cricket do you have a great day and stay safe bye now"
- 'no no no when i was um um the last person that i talked to the one i hung up hung up on me was supposed to be the supervisor okay'
- "and then when i asked i didn't even get to speak to the supervisor provider i just got hung up on"
|
| 60 | - 'okay okay do you have this this number this number next to you right now this device'
- 'uh i mean do you want to speak with a spam with a spanish the sedative'
- 'to go and content the number her aah let me know if you get the i d the i m e i or if the call will went through through and then um once you have do you have it just put me on hold and i will be waiting for the for the i m e i d okay'
|
| 7 | - "i i can't fight it but it's frustrating you know"
- "and and sometimes it's like the weather i hear i hear a horrible well"
- "i just need to work working phone and and it's it's been like oh like a ridiculous you two months about this office and then when i called and they told me they told me that i have the proof of this whole time but it doesn't make sense because i just was never never told that"
|
| 33 | - 'i hate the new system'
- 'do what ever you want'
- 'i do not have time for your stories'
|
| 4 | - 'hello welcome to correct to cricket this is my nonna can i get your name please please'
- 'welcome to cricket click admission my name is john can i have your name please name please'
- "thank you for calling verizon wireless my name yes my name is better which one will i be having a pleasure let's you're speaking with"
|
| 3 | - 'thank you so very much for waiting waiting and i was able to verify all this information in the house and the hot spot has been successfully add it just to make sure to make sure the services are working aah uh i can give you a call back but what you will need to do be do be to restart your phone turn it off and then turn it back turn it back on and then i can give you a call back in call back in two to three minutes'
- "okay okay you know you're almost there it's until september september the twenty sixth that this phone is due is due to be unlocked"
- 'okay can you try to go to go and not just like to internet google google good up or something like that there'
|
| 61 | - 'very good thank you so much'
- 'so much higher i appreciate that'
- "okay well thank you so i'm not sure"
|
| 22 | - 'i was put on hold'
- 'i v r is terrible'
- 'i v r has too many options'
|
| 30 | - 'service has been a bit unpredictable'
- 'outage will continue'
- 'network outages'
|
| 48 | - "was able to resolve it it's of your concern today but simply performing it troubleshooting shipping for your service uh miss is everything"
- "you're welcome and before i let you go to i just want to just want to let you know i'm happy i was able to resolve your concern your concern"
- "hmm but the question is how come i wasn't able to able to when i go there and now i'm not able to connect when i so um"
|
| 39 | - 'send the document'
- 'email the document'
- 'email the details'
|
| 10 | - 'all right well thank you so much for that one for that one month um can you please tell me how can i assist you today'
- "you're welcome other back thank you so much for your patience patience um i already restore the line"
- "okay okay all righty aah aah we'll do that today thank you so much"
|
| 57 | - 'to add line'
- 'add a new one'
- 'like to add a line'
|
| 50 | - "all right okay that's fine so on the records answer the and before we can to cancel the line of what i can see it here you do you have three lines lines active for fifty five dollar plan a plan so on the monthly basis you're paying one one hundred one dollars because there is like an insurance sure it's on the line and then once it would be me remove the insurance also be removed it as well this line okay and once it will be you will be removed there's also changes on the bill so if the line will be canceled it will be out of the automated that it was aah the effective today though okay that will be cancelling the line and then the line the line going to be ported out anymore and also so then you service as of the line will not be refund refunded nor credited and that's what i can see here here on the eighteenth would be your do right"
- "or the kitchen so before before we can do to where it's supposed to be used let me pull me once you cancel the line if you change your change your mind you will need to pay fifteen dollars it's for the reactivation"
- "okay so before we cancel the line is there some there's something else on your account that i can help you with or with or only will be the cancellation"
|
| 8 | - 'okay just stay on the line while i work on your on your account can i put you on a brief hold a logging into logging'
- 'okay let me let me put you on put you on a brief hold for a moment okay'
- 'please christopher open aah confirm it here material quick i place you on hold for a minute one moment'
|
| 36 | - "yeah sure thing sure thank you so much for your patience waiting on the line and and and i'm so sorry for the long hold while i while i really do appreciate the again i understand how important port and this is for you and appreciate also that time time that you really drop by on the tickets to worry about this about this concern but as i check for back further here um as i can it's confirmed it it's really not in the sim card but okay but instead on the device that you're using right using right now aah the i m e i i of the device ending in zero nine zero nine zero five this phone is no longer no longer compatible here with a service it it said cricket and that's the reason right now now that the service will not work call because of the phone so we can we can confirm right here that on the like lines that things that you have right here on the account this is the only one one that is currently an active so i even way like it like either to inquire on the crickets for it's for because we can see right here if maybe you are you are qualified for a device upgrade or maybe if you have if you have a spare phone now we can check if this is the this is still compatible with the service at cricket because we can update the i m e i of i of this phone"
- "hmm okay so if you're if you were to have it activated right right now you the the phone will be eligible for an locked bye by upto per ten"
- "if you upgrade as per as per checking here you're eligible for a device that hi discount so that means if you plan you plan on upgrading your device you can definitely and i only have a discount as long as you're logged log in your account over cricket wireless dot com com you can choose your device will recover device device if you should be able to receive a discount discount"
|
| 54 | - 'thank you got this one not this one here and this is for me to send to get your get your account can i have the four digit pin please'
- 'the forgot user name'
- 'oh four alrighty all righty thank you and how about the four digit pin digit pin on the account to verify'
|
| 63 | - 'um are there any way i can call back back in a few minutes'
- "the aah assurance taken off of the other line other line that's on my account but aah okay you got already a letter to the end of it told me that because my account was account was credited eight dollars from the check in the insurance off i thought i only two dollars so when i call back uh to so the card information to you to pay it it tells me that aah or whoever whoever told me that there is no no um i haven't shown in the system but there was any changes made"
- "i will give you all a call back when i'm ready i'm ready"
|
| 43 | - 'i know who i am seeing'
- "add add in that case i'm glad i was able to provide the details this is my callaghan from cricket stay safe always and bye for now"
- 'welcome to cricket the coordination this is josie may i have your name please please'
|
| 55 | - 'and one day at one on my account not the not and they brought a blocked or lot layest balance and she said it said it would phone was sound to call back all that and they did take the block fully at all all'
- "thank you for free you were picking up the phone call but anyway if there's anything else feel free feel free to call us back where aah always open aah before also nine"
- "in this case then um mister mister walker where we'll need to do is i will need you to wanting you to turn off your device for uh um five minutes and then turn it back on and i and i'll be calling them back in around ten minutes okay for you not you not to call back customer care new for you not to wait and to wait anymore okay"
|
| 5 | - "yes sir in this case uh from meanwhile it we're doing this jamie name is uh you can also get enroll or roll on the autopay you have aah you have a single line uh recommend you to ready to do that so you can have the five dollar discount setup in"
- "okay okay and you may add on a debit or credit card with them them and aah that will provide you five dollar discount a discount on your next month's bill right"
- "okay and usually usually um regarding here on the account do you have autopay autopay on the account and that's why i'm just aah we're just paying for fifty eight dollars a month instead of start of sixty three so here it's aah um too early for us to like give the credit credit on the account because we're crediting over give were giving the five dollar discount or credit aah aah five days before the due date to tech so technically that will be on the twentieth twenty second of august the starting that day what day you can see that the new amount is just it's just fifty eight instead of sixty three okay"
|
| 14 | - 'hold on hold on twenty alright allen so i'
- 'okay yeah then well hold on hold on a shit to that should i would like to me maybe somebody know lane okay aah are you ready'
- "so hold on hold on we're on the side okay i sent a text message search that you receive uh any text message text message coming from cricket"
|
| 2 | - "wasn't aware of the fee"
- 'a lot of hidden cost'
- 'high price'
|
| 58 | - "i'm gonna go ahead and you transfer"
- "i'm happy to transfer you"
- 'uh yes i can transfer transfer you to record to the insurance aah i can aah i can give you the number there'
|
| 37 | - 'okay tell me apart from that anything else that you might want you might want to apply to your account'
- 'this do you have any other concerns'
- 'no problem and yeah and yes now that we have successfully aah process aah process the payment andrea do you have any other question the questions or concerns'
|
| 23 | - "okay just timing can i be lohman here okay perfect just a moment one moment here it may i please you in a brief hold ma'am"
- 'okay just stay on the line while i work on your on your account can i put you on a brief hold a logging into logging'
- "okay thank you so much for that information shannon for your help as well now let me go ahead go ahead and just work on my system i cage if you don't mind don't mind going to put you just on a brief hold once i have the i have"
|
| 52 | - "thank you you're welcome"
- "all i'm really i'm really sorry that your son is having issues with this so the services no worries let me pull up your account account so i could help you check it may i have your i have your"
- "no worries no worries no worries thank you very much for verifying the confirmation make sure that i hear me okay yeah no worries take your time when you're ready tony okay tony okay"
|
| 28 | - "i do not i do not have the wifi on um and i only have my daughter on like i been i've been i've been dealing with us from going on three three days and i'm like on so so frustrated cricket stores i tried calling calling them right please are closed today cause labor day okay"
- "yeah well aah i i think you need to have your manager go back and listen to the into the call that's recorded because clearly he told me on help me on the phone that i could say uh my bank is thank you should probably have your manager go back and listen to the to the phone call so she can hear what he said"
- 'aah if you will enroll that counterfeits which way you can get seven extension mention aah for example you an android that kind of which the bitch paid today your aah your your um your page pay your extension this time start on the twenty second upon but yeah one two nine two three four five six saffron up until the twenty eight twenty eight of august'
|
| 59 | - 'instructions not clear'
- 'waiting for installation'
- 'slow installation process'
|
| 53 | - "thank you so much and i'm glad i was and i was able to resolve your concern by uh now so that you can now enjoy the retail services once once again nicole this is berna and thank you purchasing cricket and have a great day bye"
- 'thank you sir thank you so much so right now sage i would just like the car to clarify are you trying to pay your bill on your bill on your online cricket account however you forgot your forgot your password or you forgot'
- "okay perfect so thank you so much for being part we type precondition my name is marlin and i hope you have a wonderful day ma'am"
|
| 45 | - 'brian high ryan how are you doing how are you doing today'
- "i'm great sir um um how about you"
- 'agent how are you today'
|
| 41 | - 'all right just can i can i have the card number to process the payment one more time'
- 'okay hmm um we will also going to uh verify that one to for you okay for you okay the way alright so let me check check here and it seems like that that the um card that decline here can you please give me please give me one more time the card number just to make sure i have'
- 'you know that person that you really really you know who will actually receive this phone they might be able to at least activate the one with one with cricket number that way they can actually surely continue the six months aah can you repeat it written requirements so they can use it with different carrier carrier'
|
| 17 | - 'welcome to recap my name is sheila hello how can i help you today'
- 'just a great week quick recap um corban you calling because one because you wanted'
- 'i woke up to recap my name is sheila uh how can i help you today'
|
| 34 | - 'i am definitely interested'
- 'what is the extended warranty'
- 'what are the accessories'
|
| 25 | - "my pleasure sir and and uh and uh remember also that all of your lines right now in this case this account i already active okay i don't know uh there's uh there's anything else i can do for you today mister word"
- "i don't know if it's in there"
- "hmm okay okay remember that some well oh i old i don't know if you have well well do you have a p s four o a place agent or an excellent"
|
| 24 | - 'choosing cricket just my name is danielle how may i have the pleasure to speak to thank you'
- 'welcome to pick condition my name and my name is judy may i have your name please'
- "me the opportunity to assist you in it see i explained to you about your services again my name is arlene enjoy the rest of the day ma'am stay safe and happy weekend"
|
| 9 | - 'how many times to call'
- 'kept calling'
- 'did not get an answer before'
|
| 1 | - "okay i understand and i know it's kind of kind of frustrating to get uh try to just you just a services and that isn't working working but no worries is going to be my pleasure today sure today to check up your account and see what's going what's going on so can you please provide me your phone number number"
- "hi victoria toria um thanks for patiently waiting all right so i check your account further further and i also check um the payment that you made paid and um the payment the payment was already posted um i believe leave um you made the payment today and it was so do as of um is it and it's um sixty dollars dollars right but um your account is already cancelled that's why the that's why the system will require the system will require required to pay aah are we activation fee of five days five dollars okay so looking into the account right now right now there is a balance here or here on five dollars okay so this check just charge is valid this is for for the for the activation fee okay but don't worry okay um let me go ahead go ahead and ask permission from my support my supervisor if we can do something about the five the five dollars amount onto your account okay"
- "joe your account to reach pay we will extend extend your services for seven days with a process processing the full payment on the account on the on the seven days which is the twenty second second you need to process the the whole amount or you need the price to process the second payment since you're rate plan is sixty five or your bill is sixty sixty five then the only paying payment that you going to process next time is the is the amount of fifty five dollars ten ten dollars go to your services five dollars there's to your account then as well as well as you have credit as well so i'll just set up you set up the bitch pay okay"
|
| 29 | - 'when will the enrollment be done'
- 'when will the offer be activated'
- 'how long will it take to be delivered'
|
| 32 | - 'always data issues'
- "don't use this"
- 'data plan not suffice'
|
| 18 | - 'not interested'
- 'i dont want it'
- 'not for me'
|
| 44 | - 'customer service sucks here'
- 'service agent scheduled didnt come'
- 'i have been waiting on the automated system forever'
|
| 26 | - 'yes lets go ahead'
- 'sure i like the deal'
- 'please proceed with the offer'
|
| 42 | - 'includes more data'
- "they don't charge for"
- 'plan was good'
|
| 40 | - 'upgrading to the plan will resolve this issue'
- 'upgrade plan to resolve issue'
|
| 38 | - 'not a great equipment'
- 'battery runs out'
- 'problems with your equipment'
|
## Evaluation
### Metrics
| Label | Accuracy |
|:--------|:---------|
| **all** | 0.5463 |
## Uses
### Direct Use for Inference
First install the SetFit library:
```bash
pip install setfit
```
Then you can load this model and run inference.
```python
from setfit import SetFitModel
# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("Jalajkx/all_mpnetcric-setfit-model")
# Run inference
preds = model("and then when i asked i didn't even get to speak to the supervisor provider i just got hung up on")
```
## Training Details
### Training Set Metrics
| Training set | Min | Median | Max |
|:-------------|:----|:--------|:----|
| Word count | 1 | 32.4224 | 283 |
| Label | Training Sample Count |
|:------|:----------------------|
| 0 | 36 |
| 1 | 36 |
| 2 | 36 |
| 3 | 36 |
| 4 | 36 |
| 5 | 36 |
| 6 | 36 |
| 7 | 36 |
| 8 | 36 |
| 9 | 6 |
| 10 | 36 |
| 11 | 36 |
| 12 | 36 |
| 13 | 9 |
| 14 | 36 |
| 15 | 36 |
| 16 | 17 |
| 17 | 36 |
| 18 | 4 |
| 19 | 29 |
| 20 | 30 |
| 21 | 36 |
| 22 | 25 |
| 23 | 36 |
| 24 | 36 |
| 25 | 36 |
| 26 | 4 |
| 27 | 36 |
| 28 | 36 |
| 29 | 4 |
| 30 | 8 |
| 31 | 36 |
| 32 | 4 |
| 33 | 36 |
| 34 | 11 |
| 35 | 36 |
| 36 | 36 |
| 37 | 36 |
| 38 | 10 |
| 39 | 13 |
| 40 | 2 |
| 41 | 36 |
| 42 | 9 |
| 43 | 36 |
| 44 | 10 |
| 45 | 36 |
| 46 | 36 |
| 47 | 14 |
| 48 | 36 |
| 49 | 36 |
| 50 | 36 |
| 51 | 36 |
| 52 | 36 |
| 53 | 36 |
| 54 | 36 |
| 55 | 36 |
| 56 | 36 |
| 57 | 36 |
| 58 | 36 |
| 59 | 8 |
| 60 | 36 |
| 61 | 36 |
| 62 | 36 |
| 63 | 36 |
### Training Hyperparameters
- batch_size: (4, 4)
- num_epochs: (1, 1)
- max_steps: -1
- sampling_strategy: oversampling
- num_iterations: 25
- body_learning_rate: (2e-05, 2e-05)
- head_learning_rate: 2e-05
- loss: CosineSimilarityLoss
- distance_metric: cosine_distance
- margin: 0.25
- end_to_end: False
- use_amp: False
- warmup_proportion: 0.1
- seed: 42
- eval_max_steps: -1
- load_best_model_at_end: False
### Training Results
| Epoch | Step | Training Loss | Validation Loss |
|:------:|:-----:|:-------------:|:---------------:|
| 0.0000 | 1 | 0.2196 | - |
| 0.0022 | 50 | 0.2183 | - |
| 0.0044 | 100 | 0.3574 | - |
| 0.0065 | 150 | 0.1756 | - |
| 0.0087 | 200 | 0.1396 | - |
| 0.0109 | 250 | 0.2875 | - |
| 0.0131 | 300 | 0.1307 | - |
| 0.0152 | 350 | 0.1465 | - |
| 0.0174 | 400 | 0.1503 | - |
| 0.0196 | 450 | 0.1579 | - |
| 0.0218 | 500 | 0.3216 | - |
| 0.0240 | 550 | 0.2399 | - |
| 0.0261 | 600 | 0.2824 | - |
| 0.0283 | 650 | 0.1217 | - |
| 0.0305 | 700 | 0.0647 | - |
| 0.0327 | 750 | 0.2651 | - |
| 0.0348 | 800 | 0.1792 | - |
| 0.0370 | 850 | 0.1461 | - |
| 0.0392 | 900 | 0.0256 | - |
| 0.0414 | 950 | 0.1175 | - |
| 0.0435 | 1000 | 0.2394 | - |
| 0.0457 | 1050 | 0.1582 | - |
| 0.0479 | 1100 | 0.2785 | - |
| 0.0501 | 1150 | 0.0611 | - |
| 0.0523 | 1200 | 0.1937 | - |
| 0.0544 | 1250 | 0.0804 | - |
| 0.0566 | 1300 | 0.0811 | - |
| 0.0588 | 1350 | 0.0663 | - |
| 0.0610 | 1400 | 0.2148 | - |
| 0.0631 | 1450 | 0.0428 | - |
| 0.0653 | 1500 | 0.0083 | - |
| 0.0675 | 1550 | 0.0884 | - |
| 0.0697 | 1600 | 0.1341 | - |
| 0.0719 | 1650 | 0.0949 | - |
| 0.0740 | 1700 | 0.1839 | - |
| 0.0762 | 1750 | 0.2244 | - |
| 0.0784 | 1800 | 0.0309 | - |
| 0.0806 | 1850 | 0.0277 | - |
| 0.0827 | 1900 | 0.2016 | - |
| 0.0849 | 1950 | 0.1174 | - |
| 0.0871 | 2000 | 0.0942 | - |
| 0.0893 | 2050 | 0.0483 | - |
| 0.0915 | 2100 | 0.2057 | - |
| 0.0936 | 2150 | 0.0151 | - |
| 0.0958 | 2200 | 0.023 | - |
| 0.0980 | 2250 | 0.0514 | - |
| 0.1002 | 2300 | 0.1541 | - |
| 0.1023 | 2350 | 0.1426 | - |
| 0.1045 | 2400 | 0.0187 | - |
| 0.1067 | 2450 | 0.0386 | - |
| 0.1089 | 2500 | 0.274 | - |
| 0.1110 | 2550 | 0.0723 | - |
| 0.1132 | 2600 | 0.0115 | - |
| 0.1154 | 2650 | 0.053 | - |
| 0.1176 | 2700 | 0.2371 | - |
| 0.1198 | 2750 | 0.2472 | - |
| 0.1219 | 2800 | 0.0386 | - |
| 0.1241 | 2850 | 0.0159 | - |
| 0.1263 | 2900 | 0.0276 | - |
| 0.1285 | 2950 | 0.1229 | - |
| 0.1306 | 3000 | 0.0037 | - |
| 0.1328 | 3050 | 0.0029 | - |
| 0.1350 | 3100 | 0.0037 | - |
| 0.1372 | 3150 | 0.022 | - |
| 0.1394 | 3200 | 0.0389 | - |
| 0.1415 | 3250 | 0.0146 | - |
| 0.1437 | 3300 | 0.0034 | - |
| 0.1459 | 3350 | 0.0721 | - |
| 0.1481 | 3400 | 0.0462 | - |
| 0.1502 | 3450 | 0.0039 | - |
| 0.1524 | 3500 | 0.1225 | - |
| 0.1546 | 3550 | 0.0009 | - |
| 0.1568 | 3600 | 0.1005 | - |
| 0.1590 | 3650 | 0.008 | - |
| 0.1611 | 3700 | 0.121 | - |
| 0.1633 | 3750 | 0.2982 | - |
| 0.1655 | 3800 | 0.008 | - |
| 0.1677 | 3850 | 0.001 | - |
| 0.1698 | 3900 | 0.216 | - |
| 0.1720 | 3950 | 0.0458 | - |
| 0.1742 | 4000 | 0.0155 | - |
| 0.1764 | 4050 | 0.1235 | - |
| 0.1785 | 4100 | 0.0059 | - |
| 0.1807 | 4150 | 0.2421 | - |
| 0.1829 | 4200 | 0.2232 | - |
| 0.1851 | 4250 | 0.0396 | - |
| 0.1873 | 4300 | 0.2164 | - |
| 0.1894 | 4350 | 0.0839 | - |
| 0.1916 | 4400 | 0.0116 | - |
| 0.1938 | 4450 | 0.2666 | - |
| 0.1960 | 4500 | 0.0648 | - |
| 0.1981 | 4550 | 0.074 | - |
| 0.2003 | 4600 | 0.077 | - |
| 0.2025 | 4650 | 0.0739 | - |
| 0.2047 | 4700 | 0.0029 | - |
| 0.2069 | 4750 | 0.0679 | - |
| 0.2090 | 4800 | 0.0049 | - |
| 0.2112 | 4850 | 0.0281 | - |
| 0.2134 | 4900 | 0.049 | - |
| 0.2156 | 4950 | 0.0052 | - |
| 0.2177 | 5000 | 0.1657 | - |
| 0.2199 | 5050 | 0.0005 | - |
| 0.2221 | 5100 | 0.0041 | - |
| 0.2243 | 5150 | 0.0008 | - |
| 0.2265 | 5200 | 0.0587 | - |
| 0.2286 | 5250 | 0.0753 | - |
| 0.2308 | 5300 | 0.1744 | - |
| 0.2330 | 5350 | 0.0055 | - |
| 0.2352 | 5400 | 0.0023 | - |
| 0.2373 | 5450 | 0.0002 | - |
| 0.2395 | 5500 | 0.0472 | - |
| 0.2417 | 5550 | 0.0042 | - |
| 0.2439 | 5600 | 0.0137 | - |
| 0.2460 | 5650 | 0.1646 | - |
| 0.2482 | 5700 | 0.0509 | - |
| 0.2504 | 5750 | 0.0062 | - |
| 0.2526 | 5800 | 0.0019 | - |
| 0.2548 | 5850 | 0.0048 | - |
| 0.2569 | 5900 | 0.0031 | - |
| 0.2591 | 5950 | 0.0011 | - |
| 0.2613 | 6000 | 0.004 | - |
| 0.2635 | 6050 | 0.0498 | - |
| 0.2656 | 6100 | 0.0042 | - |
| 0.2678 | 6150 | 0.0018 | - |
| 0.2700 | 6200 | 0.0061 | - |
| 0.2722 | 6250 | 0.1355 | - |
| 0.2744 | 6300 | 0.0039 | - |
| 0.2765 | 6350 | 0.0044 | - |
| 0.2787 | 6400 | 0.001 | - |
| 0.2809 | 6450 | 0.0011 | - |
| 0.2831 | 6500 | 0.0302 | - |
| 0.2852 | 6550 | 0.1502 | - |
| 0.2874 | 6600 | 0.0029 | - |
| 0.2896 | 6650 | 0.0016 | - |
| 0.2918 | 6700 | 0.0232 | - |
| 0.2940 | 6750 | 0.176 | - |
| 0.2961 | 6800 | 0.0323 | - |
| 0.2983 | 6850 | 0.0818 | - |
| 0.3005 | 6900 | 0.0427 | - |
| 0.3027 | 6950 | 0.1716 | - |
| 0.3048 | 7000 | 0.0137 | - |
| 0.3070 | 7050 | 0.0032 | - |
| 0.3092 | 7100 | 0.0095 | - |
| 0.3114 | 7150 | 0.177 | - |
| 0.3135 | 7200 | 0.0005 | - |
| 0.3157 | 7250 | 0.0157 | - |
| 0.3179 | 7300 | 0.0012 | - |
| 0.3201 | 7350 | 0.0027 | - |
| 0.3223 | 7400 | 0.1351 | - |
| 0.3244 | 7450 | 0.0019 | - |
| 0.3266 | 7500 | 0.0009 | - |
| 0.3288 | 7550 | 0.2017 | - |
| 0.3310 | 7600 | 0.0059 | - |
| 0.3331 | 7650 | 0.0013 | - |
| 0.3353 | 7700 | 0.0377 | - |
| 0.3375 | 7750 | 0.0056 | - |
| 0.3397 | 7800 | 0.0055 | - |
| 0.3419 | 7850 | 0.0745 | - |
| 0.3440 | 7900 | 0.0046 | - |
| 0.3462 | 7950 | 0.002 | - |
| 0.3484 | 8000 | 0.0355 | - |
| 0.3506 | 8050 | 0.0004 | - |
| 0.3527 | 8100 | 0.0004 | - |
| 0.3549 | 8150 | 0.0072 | - |
| 0.3571 | 8200 | 0.0013 | - |
| 0.3593 | 8250 | 0.0032 | - |
| 0.3615 | 8300 | 0.0006 | - |
| 0.3636 | 8350 | 0.0095 | - |
| 0.3658 | 8400 | 0.0006 | - |
| 0.3680 | 8450 | 0.0005 | - |
| 0.3702 | 8500 | 0.0004 | - |
| 0.3723 | 8550 | 0.0019 | - |
| 0.3745 | 8600 | 0.0002 | - |
| 0.3767 | 8650 | 0.0015 | - |
| 0.3789 | 8700 | 0.0117 | - |
| 0.3810 | 8750 | 0.002 | - |
| 0.3832 | 8800 | 0.0005 | - |
| 0.3854 | 8850 | 0.0009 | - |
| 0.3876 | 8900 | 0.0041 | - |
| 0.3898 | 8950 | 0.0484 | - |
| 0.3919 | 9000 | 0.0058 | - |
| 0.3941 | 9050 | 0.0027 | - |
| 0.3963 | 9100 | 0.0002 | - |
| 0.3985 | 9150 | 0.2323 | - |
| 0.4006 | 9200 | 0.0163 | - |
| 0.4028 | 9250 | 0.0333 | - |
| 0.4050 | 9300 | 0.0033 | - |
| 0.4072 | 9350 | 0.0023 | - |
| 0.4094 | 9400 | 0.0044 | - |
| 0.4115 | 9450 | 0.0142 | - |
| 0.4137 | 9500 | 0.0261 | - |
| 0.4159 | 9550 | 0.004 | - |
| 0.4181 | 9600 | 0.027 | - |
| 0.4202 | 9650 | 0.0104 | - |
| 0.4224 | 9700 | 0.0005 | - |
| 0.4246 | 9750 | 0.2452 | - |
| 0.4268 | 9800 | 0.0069 | - |
| 0.4290 | 9850 | 0.0245 | - |
| 0.4311 | 9900 | 0.0005 | - |
| 0.4333 | 9950 | 0.0041 | - |
| 0.4355 | 10000 | 0.1058 | - |
| 0.4377 | 10050 | 0.0009 | - |
| 0.4398 | 10100 | 0.0067 | - |
| 0.4420 | 10150 | 0.0832 | - |
| 0.4442 | 10200 | 0.0016 | - |
| 0.4464 | 10250 | 0.039 | - |
| 0.4485 | 10300 | 0.0078 | - |
| 0.4507 | 10350 | 0.0013 | - |
| 0.4529 | 10400 | 0.0003 | - |
| 0.4551 | 10450 | 0.0259 | - |
| 0.4573 | 10500 | 0.008 | - |
| 0.4594 | 10550 | 0.2137 | - |
| 0.4616 | 10600 | 0.0083 | - |
| 0.4638 | 10650 | 0.0206 | - |
| 0.4660 | 10700 | 0.0039 | - |
| 0.4681 | 10750 | 0.2205 | - |
| 0.4703 | 10800 | 0.0072 | - |
| 0.4725 | 10850 | 0.0436 | - |
| 0.4747 | 10900 | 0.071 | - |
| 0.4769 | 10950 | 0.0004 | - |
| 0.4790 | 11000 | 0.0147 | - |
| 0.4812 | 11050 | 0.0095 | - |
| 0.4834 | 11100 | 0.0069 | - |
| 0.4856 | 11150 | 0.0027 | - |
| 0.4877 | 11200 | 0.0151 | - |
| 0.4899 | 11250 | 0.0076 | - |
| 0.4921 | 11300 | 0.0016 | - |
| 0.4943 | 11350 | 0.1457 | - |
| 0.4965 | 11400 | 0.1454 | - |
| 0.4986 | 11450 | 0.0013 | - |
| 0.5008 | 11500 | 0.0027 | - |
| 0.5030 | 11550 | 0.0583 | - |
| 0.5052 | 11600 | 0.0029 | - |
| 0.5073 | 11650 | 0.0139 | - |
| 0.5095 | 11700 | 0.0004 | - |
| 0.5117 | 11750 | 0.0098 | - |
| 0.5139 | 11800 | 0.0009 | - |
| 0.5160 | 11850 | 0.0003 | - |
| 0.5182 | 11900 | 0.0009 | - |
| 0.5204 | 11950 | 0.0088 | - |
| 0.5226 | 12000 | 0.0006 | - |
| 0.5248 | 12050 | 0.0014 | - |
| 0.5269 | 12100 | 0.0008 | - |
| 0.5291 | 12150 | 0.0008 | - |
| 0.5313 | 12200 | 0.0008 | - |
| 0.5335 | 12250 | 0.0005 | - |
| 0.5356 | 12300 | 0.0028 | - |
| 0.5378 | 12350 | 0.0011 | - |
| 0.5400 | 12400 | 0.0136 | - |
| 0.5422 | 12450 | 0.0318 | - |
| 0.5444 | 12500 | 0.0037 | - |
| 0.5465 | 12550 | 0.0029 | - |
| 0.5487 | 12600 | 0.0073 | - |
| 0.5509 | 12650 | 0.0099 | - |
| 0.5531 | 12700 | 0.015 | - |
| 0.5552 | 12750 | 0.0047 | - |
| 0.5574 | 12800 | 0.0891 | - |
| 0.5596 | 12850 | 0.0007 | - |
| 0.5618 | 12900 | 0.0784 | - |
| 0.5640 | 12950 | 0.0636 | - |
| 0.5661 | 13000 | 0.0029 | - |
| 0.5683 | 13050 | 0.0048 | - |
| 0.5705 | 13100 | 0.0698 | - |
| 0.5727 | 13150 | 0.0002 | - |
| 0.5748 | 13200 | 0.0734 | - |
| 0.5770 | 13250 | 0.0004 | - |
| 0.5792 | 13300 | 0.0135 | - |
| 0.5814 | 13350 | 0.0034 | - |
| 0.5835 | 13400 | 0.0018 | - |
| 0.5857 | 13450 | 0.0175 | - |
| 0.5879 | 13500 | 0.0003 | - |
| 0.5901 | 13550 | 0.0002 | - |
| 0.5923 | 13600 | 0.0032 | - |
| 0.5944 | 13650 | 0.0007 | - |
| 0.5966 | 13700 | 0.0021 | - |
| 0.5988 | 13750 | 0.0019 | - |
| 0.6010 | 13800 | 0.0006 | - |
| 0.6031 | 13850 | 0.0014 | - |
| 0.6053 | 13900 | 0.0011 | - |
| 0.6075 | 13950 | 0.2383 | - |
| 0.6097 | 14000 | 0.0009 | - |
| 0.6119 | 14050 | 0.0863 | - |
| 0.6140 | 14100 | 0.0005 | - |
| 0.6162 | 14150 | 0.0017 | - |
| 0.6184 | 14200 | 0.0003 | - |
| 0.6206 | 14250 | 0.0025 | - |
| 0.6227 | 14300 | 0.0008 | - |
| 0.6249 | 14350 | 0.0005 | - |
| 0.6271 | 14400 | 0.0006 | - |
| 0.6293 | 14450 | 0.0517 | - |
| 0.6315 | 14500 | 0.0005 | - |
| 0.6336 | 14550 | 0.0075 | - |
| 0.6358 | 14600 | 0.0004 | - |
| 0.6380 | 14650 | 0.0003 | - |
| 0.6402 | 14700 | 0.0003 | - |
| 0.6423 | 14750 | 0.0045 | - |
| 0.6445 | 14800 | 0.0005 | - |
| 0.6467 | 14850 | 0.0002 | - |
| 0.6489 | 14900 | 0.0125 | - |
| 0.6510 | 14950 | 0.0015 | - |
| 0.6532 | 15000 | 0.0017 | - |
| 0.6554 | 15050 | 0.0011 | - |
| 0.6576 | 15100 | 0.0207 | - |
| 0.6598 | 15150 | 0.0002 | - |
| 0.6619 | 15200 | 0.0252 | - |
| 0.6641 | 15250 | 0.0006 | - |
| 0.6663 | 15300 | 0.0015 | - |
| 0.6685 | 15350 | 0.0018 | - |
| 0.6706 | 15400 | 0.0386 | - |
| 0.6728 | 15450 | 0.0011 | - |
| 0.6750 | 15500 | 0.0003 | - |
| 0.6772 | 15550 | 0.0007 | - |
| 0.6794 | 15600 | 0.0028 | - |
| 0.6815 | 15650 | 0.0056 | - |
| 0.6837 | 15700 | 0.0005 | - |
| 0.6859 | 15750 | 0.0002 | - |
| 0.6881 | 15800 | 0.0305 | - |
| 0.6902 | 15850 | 0.0005 | - |
| 0.6924 | 15900 | 0.0018 | - |
| 0.6946 | 15950 | 0.0011 | - |
| 0.6968 | 16000 | 0.0006 | - |
| 0.6990 | 16050 | 0.0072 | - |
| 0.7011 | 16100 | 0.0224 | - |
| 0.7033 | 16150 | 0.0011 | - |
| 0.7055 | 16200 | 0.0005 | - |
| 0.7077 | 16250 | 0.0007 | - |
| 0.7098 | 16300 | 0.0005 | - |
| 0.7120 | 16350 | 0.0028 | - |
| 0.7142 | 16400 | 0.0017 | - |
| 0.7164 | 16450 | 0.2294 | - |
| 0.7185 | 16500 | 0.0253 | - |
| 0.7207 | 16550 | 0.0122 | - |
| 0.7229 | 16600 | 0.0001 | - |
| 0.7251 | 16650 | 0.0327 | - |
| 0.7273 | 16700 | 0.0042 | - |
| 0.7294 | 16750 | 0.0008 | - |
| 0.7316 | 16800 | 0.0004 | - |
| 0.7338 | 16850 | 0.0003 | - |
| 0.7360 | 16900 | 0.0005 | - |
| 0.7381 | 16950 | 0.0003 | - |
| 0.7403 | 17000 | 0.0021 | - |
| 0.7425 | 17050 | 0.2041 | - |
| 0.7447 | 17100 | 0.0002 | - |
| 0.7469 | 17150 | 0.0006 | - |
| 0.7490 | 17200 | 0.0002 | - |
| 0.7512 | 17250 | 0.0008 | - |
| 0.7534 | 17300 | 0.068 | - |
| 0.7556 | 17350 | 0.0016 | - |
| 0.7577 | 17400 | 0.0006 | - |
| 0.7599 | 17450 | 0.0005 | - |
| 0.7621 | 17500 | 0.0011 | - |
| 0.7643 | 17550 | 0.2192 | - |
| 0.7665 | 17600 | 0.0006 | - |
| 0.7686 | 17650 | 0.0003 | - |
| 0.7708 | 17700 | 0.0017 | - |
| 0.7730 | 17750 | 0.0033 | - |
| 0.7752 | 17800 | 0.0001 | - |
| 0.7773 | 17850 | 0.0011 | - |
| 0.7795 | 17900 | 0.0302 | - |
| 0.7817 | 17950 | 0.0004 | - |
| 0.7839 | 18000 | 0.2921 | - |
| 0.7860 | 18050 | 0.0001 | - |
| 0.7882 | 18100 | 0.006 | - |
| 0.7904 | 18150 | 0.0164 | - |
| 0.7926 | 18200 | 0.0003 | - |
| 0.7948 | 18250 | 0.0021 | - |
| 0.7969 | 18300 | 0.0094 | - |
| 0.7991 | 18350 | 0.002 | - |
| 0.8013 | 18400 | 0.0405 | - |
| 0.8035 | 18450 | 0.001 | - |
| 0.8056 | 18500 | 0.2594 | - |
| 0.8078 | 18550 | 0.0075 | - |
| 0.8100 | 18600 | 0.0003 | - |
| 0.8122 | 18650 | 0.0009 | - |
| 0.8144 | 18700 | 0.0018 | - |
| 0.8165 | 18750 | 0.0007 | - |
| 0.8187 | 18800 | 0.0006 | - |
| 0.8209 | 18850 | 0.0009 | - |
| 0.8231 | 18900 | 0.0003 | - |
| 0.8252 | 18950 | 0.0006 | - |
| 0.8274 | 19000 | 0.0002 | - |
| 0.8296 | 19050 | 0.0004 | - |
| 0.8318 | 19100 | 0.0018 | - |
| 0.8340 | 19150 | 0.0007 | - |
| 0.8361 | 19200 | 0.0005 | - |
| 0.8383 | 19250 | 0.0206 | - |
| 0.8405 | 19300 | 0.0005 | - |
| 0.8427 | 19350 | 0.1918 | - |
| 0.8448 | 19400 | 0.0093 | - |
| 0.8470 | 19450 | 0.0032 | - |
| 0.8492 | 19500 | 0.0004 | - |
| 0.8514 | 19550 | 0.1727 | - |
| 0.8535 | 19600 | 0.2034 | - |
| 0.8557 | 19650 | 0.0007 | - |
| 0.8579 | 19700 | 0.0004 | - |
| 0.8601 | 19750 | 0.0001 | - |
| 0.8623 | 19800 | 0.0024 | - |
| 0.8644 | 19850 | 0.0122 | - |
| 0.8666 | 19900 | 0.0003 | - |
| 0.8688 | 19950 | 0.0093 | - |
| 0.8710 | 20000 | 0.0003 | - |
| 0.8731 | 20050 | 0.0007 | - |
| 0.8753 | 20100 | 0.0044 | - |
| 0.8775 | 20150 | 0.0006 | - |
| 0.8797 | 20200 | 0.0002 | - |
| 0.8819 | 20250 | 0.0003 | - |
| 0.8840 | 20300 | 0.0024 | - |
| 0.8862 | 20350 | 0.0051 | - |
| 0.8884 | 20400 | 0.0767 | - |
| 0.8906 | 20450 | 0.0004 | - |
| 0.8927 | 20500 | 0.0002 | - |
| 0.8949 | 20550 | 0.0007 | - |
| 0.8971 | 20600 | 0.0012 | - |
| 0.8993 | 20650 | 0.0004 | - |
| 0.9015 | 20700 | 0.0003 | - |
| 0.9036 | 20750 | 0.0002 | - |
| 0.9058 | 20800 | 0.0005 | - |
| 0.9080 | 20850 | 0.0007 | - |
| 0.9102 | 20900 | 0.0006 | - |
| 0.9123 | 20950 | 0.2469 | - |
| 0.9145 | 21000 | 0.0002 | - |
| 0.9167 | 21050 | 0.0009 | - |
| 0.9189 | 21100 | 0.002 | - |
| 0.9210 | 21150 | 0.0027 | - |
| 0.9232 | 21200 | 0.0007 | - |
| 0.9254 | 21250 | 0.0008 | - |
| 0.9276 | 21300 | 0.0265 | - |
| 0.9298 | 21350 | 0.0019 | - |
| 0.9319 | 21400 | 0.0003 | - |
| 0.9341 | 21450 | 0.0064 | - |
| 0.9363 | 21500 | 0.0003 | - |
| 0.9385 | 21550 | 0.0015 | - |
| 0.9406 | 21600 | 0.0002 | - |
| 0.9428 | 21650 | 0.0015 | - |
| 0.9450 | 21700 | 0.1497 | - |
| 0.9472 | 21750 | 0.1422 | - |
| 0.9494 | 21800 | 0.0001 | - |
| 0.9515 | 21850 | 0.0007 | - |
| 0.9537 | 21900 | 0.0053 | - |
| 0.9559 | 21950 | 0.0002 | - |
| 0.9581 | 22000 | 0.0003 | - |
| 0.9602 | 22050 | 0.1234 | - |
| 0.9624 | 22100 | 0.2087 | - |
| 0.9646 | 22150 | 0.0005 | - |
| 0.9668 | 22200 | 0.0001 | - |
| 0.9690 | 22250 | 0.0003 | - |
| 0.9711 | 22300 | 0.0004 | - |
| 0.9733 | 22350 | 0.0014 | - |
| 0.9755 | 22400 | 0.0021 | - |
| 0.9777 | 22450 | 0.0105 | - |
| 0.9798 | 22500 | 0.0009 | - |
| 0.9820 | 22550 | 0.0003 | - |
| 0.9842 | 22600 | 0.0006 | - |
| 0.9864 | 22650 | 0.0007 | - |
| 0.9885 | 22700 | 0.0021 | - |
| 0.9907 | 22750 | 0.003 | - |
| 0.9929 | 22800 | 0.0099 | - |
| 0.9951 | 22850 | 0.001 | - |
| 0.9973 | 22900 | 0.0521 | - |
| 0.9994 | 22950 | 0.0003 | - |
### Framework Versions
- Python: 3.10.13
- SetFit: 1.0.1
- Sentence Transformers: 2.2.2
- Transformers: 4.36.2
- PyTorch: 2.0.1
- Datasets: 2.16.1
- Tokenizers: 0.15.0
## Citation
### BibTeX
```bibtex
@article{https://doi.org/10.48550/arxiv.2209.11055,
doi = {10.48550/ARXIV.2209.11055},
url = {https://arxiv.org/abs/2209.11055},
author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
title = {Efficient Few-Shot Learning Without Prompts},
publisher = {arXiv},
year = {2022},
copyright = {Creative Commons Attribution 4.0 International}
}
```