diff --git "a/README.md" "b/README.md" --- "a/README.md" +++ "b/README.md" @@ -8,25 +8,24 @@ tags: metrics: - accuracy widget: -- text: okay so just inform them to re submit the order okay because that is the information - that i see right now for the cellphone phone number aah ending again one four - seven one there is the port protection so provide them again the aah aah aah port - out number to port ahead to call this one the transfer pin and they will have - to aah started over and reset make the order and i usually that should really - work -- text: hi welcome to cricket nation thanks for your patience this call may i have - your name -- text: okay okay okay let me just go ahead and wait for the car all right i have - now pulled up of the account and as i can see here the account has uh one line - under the sixty dollar plan and the due date is every the fourth of them i let - me just review the account as well as the payments on the accounts okay can i - just uh put the call on hold for just a minute or two -- text: cleveland but it could be done in the morning or tending that you've name - but it is within today okay so that's a the status for the other number which - is the one ending in one four seven one -- text: ' that yes you did receive two text messages from cricket letting you know - that your payment is due by the nine which i''m i''m not sure how exactly that - was sent to you however prize' +- text: so the representative presentative that i talked to a nine o'clock this morning + but it said that they were gonna call the customer service my service or whatever + that they were gonna call to to see if they dispute it and i didn't get a call + back bags i'm a mother of three kids i worked were two job i can't have a phone + that that's not on and i don't have the money the money to pay a hundred and fifty + six eighty six dollars you guys want me to pay right now it's restore my service +- text: i understand kelly yes let me send you a little bit about be a moment okay + is is that the pin number that you have the four days four digits that you have + with us is +- text: yeah 'cause that that's that's really that's ridiculous you know that's ridiculous + for her to do that i like i have you know all the time in the world okay all right + okay okay no i got my card no cathy she asked me for my last time and i did not + have it i'm +- text: ma'am uh thanks for holding for holding by the way everything upon checking + i'm checking here a record ma'am aah for your for your current a hot spot you + said you said you still have twenty gigabytes left +- text: and then when i asked i didn't even get to speak to the supervisor provider + i just got hung up on pipeline_tag: text-classification inference: true base_model: sentence-transformers/all-mpnet-base-v2 @@ -42,7 +41,7 @@ model-index: split: test metrics: - type: accuracy - value: 0.8571428571428571 + value: 0.5463414634146342 name: Accuracy --- @@ -62,7 +61,7 @@ The model has been trained using an efficient few-shot learning technique that i - **Sentence Transformer body:** [sentence-transformers/all-mpnet-base-v2](https://huggingface.co/sentence-transformers/all-mpnet-base-v2) - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance - **Maximum Sequence Length:** 384 tokens -- **Number of Classes:** 7 classes +- **Number of Classes:** 64 classes @@ -74,22 +73,79 @@ The model has been trained using an efficient few-shot learning technique that i - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit) ### Model Labels -| Label | Examples | -|:------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -| 0 | | -| 4 | | -| 6 | | -| 5 | | -| 1 | | -| 2 | | -| 3 | | +| Label | Examples | +|:------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| +| 0 | | +| 20 | | +| 11 | | +| 16 | | +| 35 | | +| 21 | | +| 46 | | +| 47 | | +| 6 | | +| 51 | | +| 27 | | +| 19 | | +| 62 | | +| 12 | | +| 13 | | +| 56 | | +| 31 | | +| 49 | | +| 15 | | +| 60 | | +| 7 | | +| 33 | | +| 4 | | +| 3 | | +| 61 | | +| 22 | | +| 30 | | +| 48 | | +| 39 | | +| 10 | | +| 57 | | +| 50 | | +| 8 | | +| 36 | | +| 54 | | +| 63 | | +| 43 | | +| 55 | | +| 5 | | +| 14 | | +| 2 | | +| 58 | | +| 37 | | +| 23 | | +| 52 | | +| 28 | | +| 59 | | +| 53 | | +| 45 | | +| 41 | | +| 17 | | +| 34 | | +| 25 | | +| 24 | | +| 9 | | +| 1 | | +| 29 | | +| 32 | | +| 18 | | +| 44 | | +| 26 | | +| 42 | | +| 40 | | +| 38 | | ## Evaluation ### Metrics | Label | Accuracy | |:--------|:---------| -| **all** | 0.8571 | +| **all** | 0.5463 | ## Uses @@ -109,7 +165,7 @@ from setfit import SetFitModel # Download from the 🤗 Hub model = SetFitModel.from_pretrained("Jalajkx/all_mpnetcric-setfit-model") # Run inference -preds = model("hi welcome to cricket nation thanks for your patience this call may i have your name") +preds = model("and then when i asked i didn't even get to speak to the supervisor provider i just got hung up on") ```