|
--- |
|
base_model: intfloat/e5-base-v2 |
|
library_name: setfit |
|
metrics: |
|
- accuracy |
|
pipeline_tag: text-classification |
|
tags: |
|
- setfit |
|
- sentence-transformers |
|
- text-classification |
|
- generated_from_setfit_trainer |
|
widget: |
|
- text: 'Good afternoon! Certified psychologist with 20 years of experience. My specialization: |
|
*Relations *Crises * Emotional well-being * Parent-child relationships * Professional |
|
development * Work with dependencies *Self-esteem * Individual requests With my |
|
approach, every client is unique and I will help you reach your potential. The |
|
first consultation is acquaintance and recommendations. Online on WhatsApp, Telegram, |
|
Skype platforms. Recording exclusively in private messages. Take care of yourself!' |
|
- text: Good evening! Please give me the contacts of a trusted refrigerator master. |
|
- text: People Needed for Remote Employment Schedule - Free from 850$ Weekly with |
|
us training from you only Desire! From anywhere in the world The number of places |
|
is limited! For details, write to me + in Personal |
|
- text: Guys, someone sent parcels with this carrier from Odessa to Plovdiv |
|
- text: Tell me a site in Bulgaria for the sale of animals |
|
inference: true |
|
--- |
|
|
|
# SetFit with intfloat/e5-base-v2 |
|
|
|
This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [intfloat/e5-base-v2](https://huggingface.co/intfloat/e5-base-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification. |
|
|
|
The model has been trained using an efficient few-shot learning technique that involves: |
|
|
|
1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning. |
|
2. Training a classification head with features from the fine-tuned Sentence Transformer. |
|
|
|
## Model Details |
|
|
|
### Model Description |
|
- **Model Type:** SetFit |
|
- **Sentence Transformer body:** [intfloat/e5-base-v2](https://huggingface.co/intfloat/e5-base-v2) |
|
- **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance |
|
- **Maximum Sequence Length:** 512 tokens |
|
- **Number of Classes:** 20 classes |
|
<!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) --> |
|
<!-- - **Language:** Unknown --> |
|
<!-- - **License:** Unknown --> |
|
|
|
### Model Sources |
|
|
|
- **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit) |
|
- **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055) |
|
- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit) |
|
|
|
### Model Labels |
|
| Label | Examples | |
|
|:---------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| |
|
| CVA PROGRAMS | <ul><li>"And one more thing... This is a very important point!! The Red Cross compensates Ukrainians for the cost of medicines and even surgery. But you need to provide supporting documents.... Doctor's prescription and receipts. I know that the Ukrainian woman was fully paid for the operation... Not cheap!!!"</li><li>'Good afternoon. My sister needs to close it, but it is not included in the lease agreement. Is it possible to close under this contract? Perhaps the Red Cross will be able to register it at a common address? Has anyone encountered this? Thank you in advance.'</li><li>'Contact the Red Cross, they will help you'</li></ul> | |
|
| EDUCATION | <ul><li>"And after vocational school, you won't be able to enter a university?"</li><li>'**We prepare applicants for admission to universities in Slovakia for state-funded departments. ** HIGHER AND SECONDARY EDUCATION IN SLOVAKIA IS: Free education in Slovakia Higher education in Slovakia for citizens of Ukraine, Kazakhstan, Belarus is FREE, provided that they study in the national language, that is, in Slovak. Paid form of education Admission without entrance exams, with a certificate of Slovak B1 level Ability to combine study and work The Slovak language is very close to all Slavic languages High level of security Diploma recognized in all European countries We will help you: * choose a university and a specialty * Prepare a package of documents * Recommend Slovak language courses * book a place in the dormitory * Apply for a residence permit based on studies * Provide support at all stages Our Chat <URL> **You can get a FREE consultation here **<URL>'</li><li>'Good afternoon, who is in Sofia, tell me, is there a Ukrainian school there? Still interested in sensory integration and speech therapy?thank you'</li></ul> | |
|
| LEGAL | <ul><li>'Hello) Where do I apply for a waiver of temporary protection? I need to be given a paper of refusal'</li><li>'Good afternoon. Which application can I use to see the availability of UKR status?'</li><li>'Good evening, how to refuse the status of ukr? Moving to another country'</li></ul> | |
|
| FOOD | <ul><li>'I will give rice for free, deadline until 05/01/2024, there is a nuance: I saw two weevils inside, there are four packs'</li><li>"You were invited by the church not by the Hope of the Generations, but by the New Generation. These are two different churches. It's just that they have a service on the same day and in the same hall, only the time is different. You will need to sit out the service for two hours and after it they will be issued. Help - pasta, cereals, beans. You'll report it yourself."</li><li>'Exchange, drip coffee maker for canned meat.'</li></ul> | |
|
| TRANSLATION/LANGUAGE | <ul><li>"ENGLISH ANGLIIS'KA FOR ADULTS AND CHILDREN Online English classes I propose: - individual approach (based on your needs) - high-quality materials and interesting activities - training of all aspects (speaking, listening, reading and writing) - Help with homework - Constant support and motivation I work with all levels. I have a philological education and teaching experience +380675519090 -viber, whatsapp @IYourTeacher - telegram"</li><li>'Good morning, please tell me Bulgarian language courses as part of a group, in Varna'</li><li>"From a subscriber: Hungarian classes are free for refugees. Lots of useful links and testimonials Organisation: ELTE University (teacher Kata) Level: A1 from scratch Classes: 1 time a week from 17:30 to 18:45 (19.00) on Mondays Terms: 2 times for 2-3 months Email: elte.popup.school@gmail.com Volunteers signed us up first in a Viber chat, then in a group for courses. And now it's the same scheme, only with different teachers. From time to time, there are sets. There was no textbook, each time the teacher brought printouts of the exercises. There were DZ. She spoke to us in English and Hungarian, drew on the blackboard, if it was not clear. I joined from the 10th lesson, so it was difficult at first. A group of 10-12 people of different levels and ages, at the end there were about 5 of us. They wrote a lot, did interesting exercises, learned about the family, body parts, face, home and family, transport and the street, songs, poems, there were complex texts. Not very systematic. There was no exam, we continued to study after the break. Organization: Menedek (classes at the Hungarian Converzum School) Level: A1 from scratch Classes: 2 times a week from 9.00 to 11.15 (2 hours - Tue, Thu) Timeframe: 90 days Email: menedek@menedek.hu Hungarian language school in Buda (bus 9, stop near the entrance). Small groups of 5-6 people. We were given a textbook, a notebook and a pen for free. The teacher is Hungarian, knows a little English, but tried to talk to us in Hungarian. If something is not clear, I drew it on the blackboard. Everyday Hungarian textbook (by the way, I can give it away, I have others). We studied for 90 days, then passed the exam and then the grant was not extended, probably, there were no more classes. Each lesson began with a repetition, sometimes there were DZ, they started with the alphabet, then the topics: about yourself, home, family tree, transport, questions, hobbies. There were no difficult topics. We were prepared for the exam, we were sent the same task for training, and then there was a similar one. The exam consisted of 2 parts - oral and written. Issued a certificate of completion of the courses The Menedek organization also has free courses in the office. They send the schedule by mail or Viber/Telegram. You can look at the website of the organization <URL> and write to the mail menedek@menedek.hu I didn't go myself, it's beginner level and mostly in the mornings. Organization: CARITAS Level: A1, A2 (there was a level test) Classes: 2 times a week from 16.00 to 19.00 (3 hours with a break) Timeframe: 7 months and now I am walking Teacher: Melinda (2 more classes were in another group with Levi) Email: karpataljaert@caritas.org.hu The training lasts for 90 days, we are already completing the 2nd cycle. A good teacher, they finally began to teach systematically and I spoke a little :) The MagyarOk textbook was given out for free, the second time we were given another book with exercises, now we do tasks both in the textbook and in the notebook. For the first 90 days, we studied only with the textbook, the teacher gives a lot of practice - at the beginning and at the end of the lesson. We communicate in a group, ask each other questions, more repetition and new topics, the game format was at first. There is almost no theory, we immediately analyze it with examples and talk. For the first 90 days, she did not give DZ, now she gives a small one after each lesson. The group was 5-6 people, then about 10 and now there are 5-6 of us again. Mostly girls, sometimes foreigners. The teacher speaks mainly Hungarian, sometimes he can explain in English, he knows a couple of words in Russian. After the first 90 days, there was a written exam, we repeated a little before it. Then they gave everyone certificates of completion of the stage. At the moment, these are my best courses I've tried here. It helps me to additionally study at home in the Duolingo app, read theory in Telegram channels and separately in documents - everywhere I see :) If you have any additional information or notice any inaccuracies, please email me @yakatka. #hungarian_for_refugees #hungarian_language_school #hungarian_courses"</li></ul> | |
|
| NFI | <ul><li>'I will exchange a large pack of diapers for a large washing gel or capsules (at least for 30 washes)'</li><li>'Hello, I will give things for a 98 cm boy in exchange for fruit for the child. Pickup Borodinsky. Write to me to send a photo. Have a nice day everyone'</li><li>'Registration !for urological pads for IDPs in Lviv from the Rokada Charitable Foundation is open Registration via the link <URL>'</li></ul> | |
|
| HEALTH | <ul><li>'Can anyone recommend Ukr doctors, neurologists and a doctor who can help with the spine? Kosice, Presov'</li><li>"Good morning! Can you please recommend a good pediatrician or a good children's clinic?"</li><li>'Good morning. Where in Kramatorsk can I get an ultrasound for a fee?'</li></ul> | |
|
| ANOMALY | <ul><li>'Tell your pensioner friends that a swindler walks from house to house, introduces himself as a doctor from the 5th office, offers portable devices for the treatment of joints, which are allegedly distributed by the Red Cross and they cost 20 thousand, but if the pensioner presents documents, then a discount of 5 thousand. This swindler, has psychological influence, brazenly enters the house and scams for money. The most expensive such device, costs a thousand gr.'</li><li>'If you receive a link of this format, please do not click.This is a hack.They are trying to write off money from the card!!! !'</li><li>'Making money on CryPto Can be used from any device Time 1-2 hours a day From $250/day Can be combined with the main job Write + in PM'</li></ul> | |
|
| OTHER PROGRAMS/NGOS | <ul><li>'And what if people receive from the UN, there is a refusal?'</li><li>"Girls, who designed children's online through the action of e-Baby?"</li><li>'How do you even look for 40+ ?'</li></ul> | |
|
| CONNECTIVITY | <ul><li>"Good afternoon! Who has Vodafone? Does anyone know something? Why doesn't it work here in Slovakia?"</li><li>'Who wants to meet in Poland write'</li><li>'Poker and mafia for Ukrainians - every Thursday at Lamparen Nearest game night: Thursday 2.05 18.00 Lamparen (Hlavna 115) Cost: 3-5EUR (free for beginners) New acquaintances and incredible emotions are guaranteed. There are also many other different board games for free. During the evening, you can try to play both mafia and poker (or play one thing all evening). Pre-registration is required. Registration & Details: @max_karpets.'</li></ul> | |
|
| CHILDREN | <ul><li>'ACTORS STUDIO The White Theater announces additional recruitment of children and teenagers to Ukrainian-speaking acting groups! If your child dreams: plunge into the fascinating world of reincarnation; try yourself in a variety of roles; feel free on stage; master the skills of self-presentation; learn to speak in a way that people want to listen to; learn how to parse texts of varying complexity, etc. If you have any questions, write to Telegram: @TaisijaB'</li><li>"For children aged 2-5 years (inclusive) This is for those who haven't received these kits yet 13.02.2024 And 14.02.2024 And 15.02.2024 From 10.00 a.m. to 1.00 p.m. In Sunny Beach At the IB of the Ministerial Council, in the second building, we will be giving out IOM art kits (age 2-5 years inclusive) The set includes: Paints Markers Pencils Coloring Magazines Magazines with stickers Glue Colored Paper Pencil Plain It's all packed in a folder. It is necessary to have the original closed and the copy closed (where the child is inscribed) with you. Without a copy of the closed, they do not issue sets! !!!!!!!!!!!!!! <URL>"</li><li>"**For children aged 2-5 years** (inclusive) For those who haven't received these kits yet 23.01.2024 And 24.01.2024 And 25.01.2024 From 10.00 a.m. to 1.00 p.m. In Sunny Beach At the IB of the Ministerial Council, in the second building, we will be giving out IOM art kits (age 2-5 years inclusive) The set includes: Paints Markers Pencils Coloring Pages Stickers glue Colored Paper Pencil Plain It's all in a folder. It is necessary to have a closed and a copy of the closed (where the child is inscribed) with you. Without a copy of the closed, they do not issue sets! !!!!!!!!!!!!!! <URL>"</li></ul> | |
|
| PARCEL | <ul><li>'Can I send a parcel with you from Odessa?'</li><li>'Good afternoon! Can someone share the contacts of the courier who is Budva-Bar?) I will be very grateful'</li><li>"Or in Ukraine? It is necessary to urgently hand over the child's birth certificate"</li></ul> | |
|
| PETS | <ul><li>'Please tell me a good veterinarian, I want to take a cat, if there is somewhere on Sambirskaya, it would be good'</li><li>'Good evening, please tell me what documents are needed to enter with a dog'</li><li>'Hello, we give the cat into good hands! Looking for a home) 2.5 months'</li></ul> | |
|
| TRANSPORT/MOVEMENT | <ul><li>'Has anyone flown with Ryanair with an extended passport? Not renewed, but one with a seal for 5 years. Is everything okay?'</li><li>'Transfer in Bulgaria. A cozy and safe sedan for 3 passengers and luggage. You can do it with your pets. The price of the trip will be a VERY pleasant surprise!! Territorialo Plovdiv UA +380997858133 (Telegram, Viber) BG +359888203042 (Telegram, Viber)'</li><li>'Hello! By what number is it possible to order a taxi from Budva to Podgorica airport. Thanks'</li></ul> | |
|
| SHELTER | <ul><li>'Good morning ! Ukrainian Montenegrins, please tell me where you can see apartments for rent for a long time in Budva or Podgorica?'</li><li>'And what kind of city is it? Are refugees accepted from Ukraine?'</li><li>'Tell me, please, what is the average price for renting a 3-room apartment in Varna? Thank you just at least the range'</li></ul> | |
|
| WORK/JOBS | <ul><li>'Job search on the Internet: features of the Bulgarian labor market, how to respond to a vacancy, offers for Ukrainians You will learn about all this at our FREE offline lecture on the course "Career Development in Bulgaria" from the Network of Ukrainian Educational Hubs and the Association of Innovative and Digital Education, which will be held with the support of the Central European Initiative (CEI) Speaker: Svetlozar Petrov - Managing Director of Jobtaigr OOD. When? The lecture will take place on April 22, 2024 at 18:00 Eastern European Time Duration: 1 hour Venue: Sofia, blvd. Slivnitsa, 188 in. Would. Hurry! REGISTER HERE <URL>'</li><li>'WE INVITE YOU TO WORK! Sales consultant of smartphones and accessories Truskavets We offer: High wages 14000 - 18000 thousand rubles Partial compensation for travel Convenient shift schedule Staff training PHONES OF THE PERSONNEL DEPARTMENT: 094-400-45-00 050-728-48-15 098-353-16-30'</li><li>'Good afternoon! We are looking for pharmacists and assistants, preferably with experience, to work in a large network of pharmacies in Sofia'</li></ul> | |
|
| PSS & RFL | <ul><li>'Heart-to-heart conversations over tea 12.04.2024, Friday Beginning at 16.00 For whom: for young people 15+ and adults Hlavna, 68, (our second floor, room 1.04) Blue Dot Kosice spaces We invite everyone who is interested in psychology and personal development to tea with a psychologist This week we continue to explore the theme of LONELINESS AND SOLITUDE. This Friday, we will talk about relationships, about the reasons why this feeling appears in a couple, in a team. About loneliness in emigration. We will find out what is the power of loneliness and how to strengthen your weak points. Interesting exercises are also waiting for you - self-exploration and discussion. Pre-registration is mandatory: <URL>'</li><li>'Vera Stepanova: "Help me find my sonToday, at about 15-00, in the city of Drohobych (city center), my son, Stepanov Alexander Sergeevich, born in 2010, was lost. (13 years) He was wearing a purple T-shirt, gray sweatpants and black sneakers. I ask for help in finding the child, I have informed the Police."'</li><li>'Good evening, if there is a Russian-speaking psychologist in Bratislava?'</li></ul> | |
|
| MONEY/BANKING | <ul><li>'Good afternoon, maybe someone has hryvnias on the card, I will give cash euros in PM!!'</li><li>'Tell me, please, where can I get a duplicate of the identification code and pension certificate if I am an IDP?'</li><li>'Good afternoon, who can throw hryvnias on the card in exchange for cash in euros or leva. The city of Varna will meet where it will be convenient for you. Urgent Need Help'</li></ul> | |
|
| CAR | <ul><li>'Hello, please help, where to go in the situation the guy got into an accident on the car of the company, they demand money for the repair of the car, they have already written off more than 8000 thousand zlotys, they do not provide an invoice, and they say more and more money is already repairing 12000 thousand'</li><li>'Selling a car Renault Laguna Year 2005 Complete set Automaton 5 t lion Burgas'</li><li>'Do you sell a car with Ukrainian license plates in the group? We want to buy it, because we are going home, write to the PM'</li></ul> | |
|
| GOODS/SERVICES | <ul><li>'Selling tires Falken 225/45 R17 40 euros Without wired charging 5 euros Humidifier EUR10'</li><li>'Selling new sneakers 350,00UAH'</li><li>'Hello everyone, I am selling an Acer laptop We bought it as a gift, but the child was given 2 identical ones, so it is no longer relevant Condition : Brand New Price :300 EUR Bought for 320EUR Suitable for both a child for study and a student (bought for this purpose) 2 Year Warranty Set : Box , Charger , Check, Laptop , Documents'</li></ul> | |
|
|
|
## Uses |
|
|
|
### Direct Use for Inference |
|
|
|
First install the SetFit library: |
|
|
|
```bash |
|
pip install setfit |
|
``` |
|
|
|
Then you can load this model and run inference. |
|
|
|
```python |
|
from setfit import SetFitModel |
|
|
|
# Download from the 🤗 Hub |
|
model = SetFitModel.from_pretrained("rodekruis/sml-ukr-message-classifier-2") |
|
# Run inference |
|
preds = model("Tell me a site in Bulgaria for the sale of animals") |
|
``` |
|
|
|
<!-- |
|
### Downstream Use |
|
|
|
*List how someone could finetune this model on their own dataset.* |
|
--> |
|
|
|
<!-- |
|
### Out-of-Scope Use |
|
|
|
*List how the model may foreseeably be misused and address what users ought not to do with the model.* |
|
--> |
|
|
|
<!-- |
|
## Bias, Risks and Limitations |
|
|
|
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.* |
|
--> |
|
|
|
<!-- |
|
### Recommendations |
|
|
|
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.* |
|
--> |
|
|
|
## Training Details |
|
|
|
### Training Set Metrics |
|
| Training set | Min | Median | Max | |
|
|:-------------|:----|:-------|:----| |
|
| Word count | 3 | 39.524 | 722 | |
|
|
|
| Label | Training Sample Count | |
|
|:---------------------|:----------------------| |
|
| ANOMALY | 60 | |
|
| CAR | 47 | |
|
| CHILDREN | 47 | |
|
| CONNECTIVITY | 41 | |
|
| CVA PROGRAMS | 46 | |
|
| EDUCATION | 44 | |
|
| FOOD | 57 | |
|
| GOODS/SERVICES | 51 | |
|
| HEALTH | 56 | |
|
| LEGAL | 44 | |
|
| MONEY/BANKING | 55 | |
|
| NFI | 57 | |
|
| OTHER PROGRAMS/NGOS | 55 | |
|
| PARCEL | 45 | |
|
| PETS | 48 | |
|
| PSS & RFL | 51 | |
|
| SHELTER | 47 | |
|
| TRANSLATION/LANGUAGE | 56 | |
|
| TRANSPORT/MOVEMENT | 48 | |
|
| WORK/JOBS | 45 | |
|
|
|
### Training Hyperparameters |
|
- batch_size: (16, 16) |
|
- num_epochs: (4, 4) |
|
- max_steps: -1 |
|
- sampling_strategy: undersampling |
|
- body_learning_rate: (2e-05, 1e-05) |
|
- head_learning_rate: 0.01 |
|
- loss: CosineSimilarityLoss |
|
- distance_metric: cosine_distance |
|
- margin: 0.25 |
|
- end_to_end: False |
|
- use_amp: False |
|
- warmup_proportion: 0.1 |
|
- l2_weight: 0.01 |
|
- seed: 42 |
|
- eval_max_steps: -1 |
|
- load_best_model_at_end: True |
|
|
|
### Training Results |
|
| Epoch | Step | Training Loss | Validation Loss | |
|
|:------:|:-----:|:-------------:|:---------------:| |
|
| 0.0003 | 1 | 0.1551 | - | |
|
| 0.0155 | 50 | 0.3308 | - | |
|
| 0.0310 | 100 | 0.3002 | - | |
|
| 0.0465 | 150 | 0.264 | - | |
|
| 0.0620 | 200 | 0.2227 | - | |
|
| 0.0775 | 250 | 0.1935 | - | |
|
| 0.0931 | 300 | 0.1727 | - | |
|
| 0.1086 | 350 | 0.1437 | - | |
|
| 0.1241 | 400 | 0.136 | - | |
|
| 0.1396 | 450 | 0.1204 | - | |
|
| 0.1551 | 500 | 0.0955 | - | |
|
| 0.1706 | 550 | 0.0898 | - | |
|
| 0.1861 | 600 | 0.0815 | - | |
|
| 0.2016 | 650 | 0.0662 | - | |
|
| 0.2171 | 700 | 0.0606 | - | |
|
| 0.2326 | 750 | 0.0446 | - | |
|
| 0.2481 | 800 | 0.0417 | - | |
|
| 0.2636 | 850 | 0.0384 | - | |
|
| 0.2792 | 900 | 0.0327 | - | |
|
| 0.2947 | 950 | 0.0322 | - | |
|
| 0.3102 | 1000 | 0.028 | - | |
|
| 0.3257 | 1050 | 0.0256 | - | |
|
| 0.3412 | 1100 | 0.0165 | - | |
|
| 0.3567 | 1150 | 0.0163 | - | |
|
| 0.3722 | 1200 | 0.0203 | - | |
|
| 0.3877 | 1250 | 0.0148 | - | |
|
| 0.4032 | 1300 | 0.0137 | - | |
|
| 0.4187 | 1350 | 0.0131 | - | |
|
| 0.4342 | 1400 | 0.0091 | - | |
|
| 0.4498 | 1450 | 0.0094 | - | |
|
| 0.4653 | 1500 | 0.0083 | - | |
|
| 0.4808 | 1550 | 0.0033 | - | |
|
| 0.4963 | 1600 | 0.0026 | - | |
|
| 0.5118 | 1650 | 0.0054 | - | |
|
| 0.5273 | 1700 | 0.0054 | - | |
|
| 0.5428 | 1750 | 0.0063 | - | |
|
| 0.5583 | 1800 | 0.0038 | - | |
|
| 0.5738 | 1850 | 0.0059 | - | |
|
| 0.5893 | 1900 | 0.0051 | - | |
|
| 0.6048 | 1950 | 0.0024 | - | |
|
| 0.6203 | 2000 | 0.0022 | - | |
|
| 0.6359 | 2050 | 0.002 | - | |
|
| 0.6514 | 2100 | 0.0069 | - | |
|
| 0.6669 | 2150 | 0.0025 | - | |
|
| 0.6824 | 2200 | 0.0052 | - | |
|
| 0.6979 | 2250 | 0.0033 | - | |
|
| 0.7134 | 2300 | 0.0048 | - | |
|
| 0.7289 | 2350 | 0.003 | - | |
|
| 0.7444 | 2400 | 0.0064 | - | |
|
| 0.7599 | 2450 | 0.0052 | - | |
|
| 0.7754 | 2500 | 0.0096 | - | |
|
| 0.7909 | 2550 | 0.0041 | - | |
|
| 0.8065 | 2600 | 0.0033 | - | |
|
| 0.8220 | 2650 | 0.0009 | - | |
|
| 0.8375 | 2700 | 0.0048 | - | |
|
| 0.8530 | 2750 | 0.0058 | - | |
|
| 0.8685 | 2800 | 0.0032 | - | |
|
| 0.8840 | 2850 | 0.0031 | - | |
|
| 0.8995 | 2900 | 0.0022 | - | |
|
| 0.9150 | 2950 | 0.0015 | - | |
|
| 0.9305 | 3000 | 0.0018 | - | |
|
| 0.9460 | 3050 | 0.0025 | - | |
|
| 0.9615 | 3100 | 0.0012 | - | |
|
| 0.9770 | 3150 | 0.0012 | - | |
|
| 0.9926 | 3200 | 0.0035 | - | |
|
| 1.0 | 3224 | - | 0.1048 | |
|
| 1.0081 | 3250 | 0.0024 | - | |
|
| 1.0236 | 3300 | 0.0014 | - | |
|
| 1.0391 | 3350 | 0.0012 | - | |
|
| 1.0546 | 3400 | 0.0006 | - | |
|
| 1.0701 | 3450 | 0.0014 | - | |
|
| 1.0856 | 3500 | 0.0018 | - | |
|
| 1.1011 | 3550 | 0.0012 | - | |
|
| 1.1166 | 3600 | 0.0017 | - | |
|
| 1.1321 | 3650 | 0.001 | - | |
|
| 1.1476 | 3700 | 0.0008 | - | |
|
| 1.1632 | 3750 | 0.0017 | - | |
|
| 1.1787 | 3800 | 0.0004 | - | |
|
| 1.1942 | 3850 | 0.0016 | - | |
|
| 1.2097 | 3900 | 0.0015 | - | |
|
| 1.2252 | 3950 | 0.0016 | - | |
|
| 1.2407 | 4000 | 0.0004 | - | |
|
| 1.2562 | 4050 | 0.001 | - | |
|
| 1.2717 | 4100 | 0.0004 | - | |
|
| 1.2872 | 4150 | 0.0003 | - | |
|
| 1.3027 | 4200 | 0.0018 | - | |
|
| 1.3182 | 4250 | 0.0004 | - | |
|
| 1.3337 | 4300 | 0.0029 | - | |
|
| 1.3493 | 4350 | 0.0005 | - | |
|
| 1.3648 | 4400 | 0.0003 | - | |
|
| 1.3803 | 4450 | 0.0009 | - | |
|
| 1.3958 | 4500 | 0.0003 | - | |
|
| 1.4113 | 4550 | 0.0002 | - | |
|
| 1.4268 | 4600 | 0.0014 | - | |
|
| 1.4423 | 4650 | 0.0005 | - | |
|
| 1.4578 | 4700 | 0.0006 | - | |
|
| 1.4733 | 4750 | 0.0011 | - | |
|
| 1.4888 | 4800 | 0.0006 | - | |
|
| 1.5043 | 4850 | 0.0004 | - | |
|
| 1.5199 | 4900 | 0.0004 | - | |
|
| 1.5354 | 4950 | 0.0003 | - | |
|
| 1.5509 | 5000 | 0.0005 | - | |
|
| 1.5664 | 5050 | 0.0006 | - | |
|
| 1.5819 | 5100 | 0.0005 | - | |
|
| 1.5974 | 5150 | 0.0006 | - | |
|
| 1.6129 | 5200 | 0.0006 | - | |
|
| 1.6284 | 5250 | 0.0003 | - | |
|
| 1.6439 | 5300 | 0.0007 | - | |
|
| 1.6594 | 5350 | 0.0004 | - | |
|
| 1.6749 | 5400 | 0.0002 | - | |
|
| 1.6904 | 5450 | 0.0002 | - | |
|
| 1.7060 | 5500 | 0.0001 | - | |
|
| 1.7215 | 5550 | 0.0004 | - | |
|
| 1.7370 | 5600 | 0.0003 | - | |
|
| 1.7525 | 5650 | 0.0001 | - | |
|
| 1.7680 | 5700 | 0.0002 | - | |
|
| 1.7835 | 5750 | 0.0004 | - | |
|
| 1.7990 | 5800 | 0.0003 | - | |
|
| 1.8145 | 5850 | 0.0003 | - | |
|
| 1.8300 | 5900 | 0.0007 | - | |
|
| 1.8455 | 5950 | 0.0002 | - | |
|
| 1.8610 | 6000 | 0.0002 | - | |
|
| 1.8766 | 6050 | 0.0004 | - | |
|
| 1.8921 | 6100 | 0.0006 | - | |
|
| 1.9076 | 6150 | 0.0003 | - | |
|
| 1.9231 | 6200 | 0.0001 | - | |
|
| 1.9386 | 6250 | 0.0002 | - | |
|
| 1.9541 | 6300 | 0.0003 | - | |
|
| 1.9696 | 6350 | 0.0008 | - | |
|
| 1.9851 | 6400 | 0.0002 | - | |
|
| 2.0 | 6448 | - | 0.1024 | |
|
| 2.0006 | 6450 | 0.0008 | - | |
|
| 2.0161 | 6500 | 0.0006 | - | |
|
| 2.0316 | 6550 | 0.0005 | - | |
|
| 2.0471 | 6600 | 0.0001 | - | |
|
| 2.0627 | 6650 | 0.0009 | - | |
|
| 2.0782 | 6700 | 0.0001 | - | |
|
| 2.0937 | 6750 | 0.0011 | - | |
|
| 2.1092 | 6800 | 0.0001 | - | |
|
| 2.1247 | 6850 | 0.0002 | - | |
|
| 2.1402 | 6900 | 0.0007 | - | |
|
| 2.1557 | 6950 | 0.0003 | - | |
|
| 2.1712 | 7000 | 0.0011 | - | |
|
| 2.1867 | 7050 | 0.0001 | - | |
|
| 2.2022 | 7100 | 0.0009 | - | |
|
| 2.2177 | 7150 | 0.0002 | - | |
|
| 2.2333 | 7200 | 0.0012 | - | |
|
| 2.2488 | 7250 | 0.0002 | - | |
|
| 2.2643 | 7300 | 0.0001 | - | |
|
| 2.2798 | 7350 | 0.0001 | - | |
|
| 2.2953 | 7400 | 0.0007 | - | |
|
| 2.3108 | 7450 | 0.0002 | - | |
|
| 2.3263 | 7500 | 0.0001 | - | |
|
| 2.3418 | 7550 | 0.0001 | - | |
|
| 2.3573 | 7600 | 0.0005 | - | |
|
| 2.3728 | 7650 | 0.0002 | - | |
|
| 2.3883 | 7700 | 0.0007 | - | |
|
| 2.4038 | 7750 | 0.0004 | - | |
|
| 2.4194 | 7800 | 0.0004 | - | |
|
| 2.4349 | 7850 | 0.0004 | - | |
|
| 2.4504 | 7900 | 0.0001 | - | |
|
| 2.4659 | 7950 | 0.0003 | - | |
|
| 2.4814 | 8000 | 0.0004 | - | |
|
| 2.4969 | 8050 | 0.0002 | - | |
|
| 2.5124 | 8100 | 0.0004 | - | |
|
| 2.5279 | 8150 | 0.0005 | - | |
|
| 2.5434 | 8200 | 0.0003 | - | |
|
| 2.5589 | 8250 | 0.0004 | - | |
|
| 2.5744 | 8300 | 0.0003 | - | |
|
| 2.5900 | 8350 | 0.0001 | - | |
|
| 2.6055 | 8400 | 0.0002 | - | |
|
| 2.6210 | 8450 | 0.0001 | - | |
|
| 2.6365 | 8500 | 0.0005 | - | |
|
| 2.6520 | 8550 | 0.0002 | - | |
|
| 2.6675 | 8600 | 0.0001 | - | |
|
| 2.6830 | 8650 | 0.0003 | - | |
|
| 2.6985 | 8700 | 0.0003 | - | |
|
| 2.7140 | 8750 | 0.0002 | - | |
|
| 2.7295 | 8800 | 0.0004 | - | |
|
| 2.7450 | 8850 | 0.0001 | - | |
|
| 2.7605 | 8900 | 0.0002 | - | |
|
| 2.7761 | 8950 | 0.0001 | - | |
|
| 2.7916 | 9000 | 0.0004 | - | |
|
| 2.8071 | 9050 | 0.0002 | - | |
|
| 2.8226 | 9100 | 0.0004 | - | |
|
| 2.8381 | 9150 | 0.0012 | - | |
|
| 2.8536 | 9200 | 0.0001 | - | |
|
| 2.8691 | 9250 | 0.0013 | - | |
|
| 2.8846 | 9300 | 0.0003 | - | |
|
| 2.9001 | 9350 | 0.0004 | - | |
|
| 2.9156 | 9400 | 0.0013 | - | |
|
| 2.9311 | 9450 | 0.0002 | - | |
|
| 2.9467 | 9500 | 0.0001 | - | |
|
| 2.9622 | 9550 | 0.0001 | - | |
|
| 2.9777 | 9600 | 0.0005 | - | |
|
| 2.9932 | 9650 | 0.0001 | - | |
|
| 3.0 | 9672 | - | 0.1077 | |
|
| 3.0087 | 9700 | 0.0004 | - | |
|
| 3.0242 | 9750 | 0.0001 | - | |
|
| 3.0397 | 9800 | 0.0001 | - | |
|
| 3.0552 | 9850 | 0.0001 | - | |
|
| 3.0707 | 9900 | 0.0011 | - | |
|
| 3.0862 | 9950 | 0.0003 | - | |
|
| 3.1017 | 10000 | 0.0002 | - | |
|
| 3.1172 | 10050 | 0.0003 | - | |
|
| 3.1328 | 10100 | 0.0003 | - | |
|
| 3.1483 | 10150 | 0.0001 | - | |
|
| 3.1638 | 10200 | 0.0002 | - | |
|
| 3.1793 | 10250 | 0.0002 | - | |
|
| 3.1948 | 10300 | 0.0002 | - | |
|
| 3.2103 | 10350 | 0.0001 | - | |
|
| 3.2258 | 10400 | 0.0004 | - | |
|
| 3.2413 | 10450 | 0.0004 | - | |
|
| 3.2568 | 10500 | 0.0001 | - | |
|
| 3.2723 | 10550 | 0.0001 | - | |
|
| 3.2878 | 10600 | 0.0003 | - | |
|
| 3.3033 | 10650 | 0.0002 | - | |
|
| 3.3189 | 10700 | 0.0007 | - | |
|
| 3.3344 | 10750 | 0.0006 | - | |
|
| 3.3499 | 10800 | 0.0003 | - | |
|
| 3.3654 | 10850 | 0.0002 | - | |
|
| 3.3809 | 10900 | 0.0004 | - | |
|
| 3.3964 | 10950 | 0.0005 | - | |
|
| 3.4119 | 11000 | 0.0009 | - | |
|
| 3.4274 | 11050 | 0.0002 | - | |
|
| 3.4429 | 11100 | 0.0001 | - | |
|
| 3.4584 | 11150 | 0.0003 | - | |
|
| 3.4739 | 11200 | 0.0001 | - | |
|
| 3.4895 | 11250 | 0.0002 | - | |
|
| 3.5050 | 11300 | 0.0002 | - | |
|
| 3.5205 | 11350 | 0.0002 | - | |
|
| 3.5360 | 11400 | 0.0002 | - | |
|
| 3.5515 | 11450 | 0.0002 | - | |
|
| 3.5670 | 11500 | 0.0008 | - | |
|
| 3.5825 | 11550 | 0.0006 | - | |
|
| 3.5980 | 11600 | 0.0001 | - | |
|
| 3.6135 | 11650 | 0.0003 | - | |
|
| 3.6290 | 11700 | 0.0003 | - | |
|
| 3.6445 | 11750 | 0.0005 | - | |
|
| 3.6600 | 11800 | 0.0002 | - | |
|
| 3.6756 | 11850 | 0.0003 | - | |
|
| 3.6911 | 11900 | 0.0002 | - | |
|
| 3.7066 | 11950 | 0.0 | - | |
|
| 3.7221 | 12000 | 0.0003 | - | |
|
| 3.7376 | 12050 | 0.0003 | - | |
|
| 3.7531 | 12100 | 0.0008 | - | |
|
| 3.7686 | 12150 | 0.0002 | - | |
|
| 3.7841 | 12200 | 0.0002 | - | |
|
| 3.7996 | 12250 | 0.0004 | - | |
|
| 3.8151 | 12300 | 0.0002 | - | |
|
| 3.8306 | 12350 | 0.0003 | - | |
|
| 3.8462 | 12400 | 0.0002 | - | |
|
| 3.8617 | 12450 | 0.0004 | - | |
|
| 3.8772 | 12500 | 0.0003 | - | |
|
| 3.8927 | 12550 | 0.0001 | - | |
|
| 3.9082 | 12600 | 0.0001 | - | |
|
| 3.9237 | 12650 | 0.0002 | - | |
|
| 3.9392 | 12700 | 0.0001 | - | |
|
| 3.9547 | 12750 | 0.0002 | - | |
|
| 3.9702 | 12800 | 0.0001 | - | |
|
| 3.9857 | 12850 | 0.0007 | - | |
|
| 4.0 | 12896 | - | 0.1088 | |
|
|
|
### Framework Versions |
|
- Python: 3.10.14 |
|
- SetFit: 1.1.0 |
|
- Sentence Transformers: 3.1.1 |
|
- Transformers: 4.45.1 |
|
- PyTorch: 2.4.1+cu121 |
|
- Datasets: 3.0.1 |
|
- Tokenizers: 0.20.0 |
|
|
|
## Citation |
|
|
|
### BibTeX |
|
```bibtex |
|
@article{https://doi.org/10.48550/arxiv.2209.11055, |
|
doi = {10.48550/ARXIV.2209.11055}, |
|
url = {https://arxiv.org/abs/2209.11055}, |
|
author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren}, |
|
keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences}, |
|
title = {Efficient Few-Shot Learning Without Prompts}, |
|
publisher = {arXiv}, |
|
year = {2022}, |
|
copyright = {Creative Commons Attribution 4.0 International} |
|
} |
|
``` |
|
|
|
<!-- |
|
## Glossary |
|
|
|
*Clearly define terms in order to be accessible across audiences.* |
|
--> |
|
|
|
<!-- |
|
## Model Card Authors |
|
|
|
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.* |
|
--> |
|
|
|
<!-- |
|
## Model Card Contact |
|
|
|
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.* |
|
--> |
