Edit model card

SetFit with sentence-transformers/paraphrase-mpnet-base-v2

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-mpnet-base-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

  1. Fine-tuning a Sentence Transformer with contrastive learning.
  2. Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

Model Sources

Model Labels

Label Examples
19
  • 'I usually come on to give a hard time to ‘frame rust’ posts. But damn. This thing must have dedicated parking spot, in the ocean. I never expected it to be that bad. But in saying that the truck will be fine for 20-30 years.'
  • 'Laser cut or etched with some sort of acid? Probably not just the bumper. Take a look at the frame and suspension. Make sure its not rusting. And if it is maybe you should get a frame coating of sorts'
  • 'This level of rust is common from my experience, these frames are coated with a black wax like material instead of paint. Eventually this wax material wears off and then corrosion starts. It might look ugly but as long as there are no holes or cracks the frame is fine. If you want to make it look better visually you can spray oil on the frame (like chainsaw chain lube, fluid film etc)'
13
  • 'When I want to get it cleaned quickly I do the touch less car wash there isn’t many so you’ll have to find one that does it. Also gotta be careful what kind of cleaning chemicals they use cause some products can damage the car even touch less car wash and the pressure it uses. Now if I want to take my time and makes sure it’s done right then I have my own cleaning set up for car washing it. I use Adam polishes stuff from detail to shampoo etc. I also got the Adam polishes pressure washer and the Adam polished towels to dry it up. I recommend watching a lot of videos on YouTube there’s plenty of information of what to do and not to do if you decide to clean it yourself cause you don’t wanna mess it up and cost you more to do a paint correction. Hopefully this helps? ??'
  • 'If you find one that you like, I’ve found that installing a little blue painters tape under the rack mounting points keeps the hardware from marking up the paint. Make sure it is the blue kind, it comes off much easier when you go to remove it.'
  • 'Washing the car by hand has always felt like the only option to me. A good electric power washer with the right chemicals makes it easy and wax keeps the dirt off for a good amount of time.'
18
  • 'Love the color'
  • 'Ufff she’s gleaming like a ?? stunning ??'
  • 'The spray paint is cool (and encouraged), but I do wish I could have seen them freshly planted and shiny as well. ... I still say we do this when we retire the current racecars ;) #SubaruRanch \n \n #CadillacRanch #Amarillo\n #TX #automotive #rt66 #America #americanhistory\n #travel #adventure #subaru'
20
  • 'Yeah I don’t want to be putting plastidip or something on a brand new truck. This would be a lot but what about getting them painted gloss black to match the grille on the inside and and have the chrome be matte black similar to some of the trim'
  • 'Foose F104 LEGEND Gloss Black Milled, i think would look great, and are only about 270.00 for Foose good price'
  • 'Nice, love the matte paint/wrap!'
15
  • 'True are you taking New customer I have a 1937 buick no dent little surface rust'
  • "Steelbrush, steel wool, clean with vinegar solution and finish with flex seal. Stops water and oxygen. No oxygen means no oxidation which means no rust. Back in the day they would save rust and add it to their paint or whitewash which gave the barn it's distinctive color which is often imitated but rarely duplicated."
22
  • 'I’ve got a 2021 Gretsch g6128t-57 duo jet in Cadillac green. The guitar is in excellent condition with some minor scratches and swirls too hard to photograph. Got it from a fellow forum brother about 5 months ago for my first foray into Gretsch guitars.'
  • 'Hopefully you don’t find too many surprises when you take the paint off. Yeah, it’s hard to tell condition from pictures. Good luck with your project.'
  • "$8,999 but just test drove it and I don't think im going to get it because it looked a lot better in the pictures. Has been kept dirty on the lot and there are a lot of swirl marks and it's just not in the best condition as I hoped. Some things are wrong with the interior too. The screen In the dash has some weird spots and there's obviously some electrical issues because the interior lights don't turn off lol"
2
  • 'I had a similar situation with a black GMC truck and an APC. The roof and top edge of the hood had visible oxidation setting in. '
  • 'Finally got it detailed. Car looked great from a distance, but up close had lot of oxidation from sitting up for a while. '
  • 'Have this on my charger hood, small oxidation spot, I was told a new hood is the best option (OEM) does getting it repainted actually work? It was a very reputable non dealer body shop'
21
  • "Click for more info and reviews of this Malone Watersport Carriers:\n \n https://www.etrailer.com/Watersport-Carriers/Malone/MPG107MD.html\n \n Check out some similar Watersport Carriers options:\n \n https://www.etrailer.com/dept-pg-Watersport_Carriers-sf-Kayak.aspx\n \n \n \n Search for other popular Chevrolet Equinox parts and accessories:\n \n https://www.etrailer.com/vehicle/2020/Chevrolet/Equinox\n \n \n \n https://www.etrailer.com\n \n Don’t forget to subscribe! https://www.youtube.com/user/etrailertv\n \n \n \n Full transcript: https://www.etrailer.com/tv-install-malone-seawing-kayak-carrier-2020-chevrolet-equinox-mpg107md.aspx\n \n Hey everyone, Charles here at etrailer. And today we're taking a look at the Malone SeaWing Kayak Carrier on the 2020 Chevrolet Equinox. These are gonna be your saddle style kayak carrier. So they're gonna be great for your extra long or your extra wide kayaks that don't fit in a J-style carrier. On our 54 inch crossbars, we still have plenty of room for another set of these for another kayak or even a bike or a cargo basket. These are gonna be made out of a polycarbonate material. They're gonna be very durable and corrosion resistant. They come with the nylon straps as well as the bow and stern tie-downs. And these are gonna fit most of your factory cross bars. We have these on the arrow style and they fit nicely on those, but as well as your square and your round bars as well. And on the inside of the saddle, there is a nice, it's like a thick rubber with grooves for added traction and protection for your kayak. Weight capacity is gonna handle your kayaks of up to 75 pounds. And one thing that I really like about this is that you don't need any tools to install it, So it's very quick to install and uninstall. Just make sure that you have plenty of clearance right here for your crossbar since you do have to twist the knobs underneath your crossbars. Your saddle style kayak carriers are gonna give you extra clearance compared to your J-style kayak carriers. So that's gonna be beneficial for you if you have a larger vehicle like Yukon so that you can park into your garage or go through a drive-through or anything like that. So overall, these are a very solid and durable build, that's gonna last you a long time and it's gonna be perfect for you if you have your extra long or extra wide kayaks. To begin the installation, we have everything laid out that we're gonna use. Malone does provide us with two sets of bolts. A small and a large. We are using the large for our arrow style crossbars that we have. We installed the front carry already but we'll do the rear together. So I'm just gonna stick the bolts through. And then this padded bar, the groove is going to face this way and we're just gonna loosely, loosely screw this guy on. If I get to the same spot, I like to squeeze them in at the same time so that we get an even distribution and so that the carrier isn't lopsided when we tighten them down. All right, so we have the red strap here. We are going to go up through the top. I mean, I guess down to the top and then up through the closer slot here. And we are just gonna set these off to the side until we load a kayak on, then we can just throw it over. This is your rear loading kayak carrier. So if you didn't have the Malone C suction cup attachment that you purchased separately, you can always just lay a thicker pad over here, that way you're not scratching your vehicle. But these are actually close enough to the edge of our arrow bars. And I'm tall enough to just slide it on through the side here. It's not the best way but it gets it done. So now I'm just gonna wrap our straps across the top. Make sure that these are flat. Making sure that this leather part on the buckle is facing our kayak to avoid any metal on our kayak here. And then we're just gonna do the same thing on this side. Going down and then up. Pull that through. Through the leather strap and then up through our buckle here. And then we can just roll up the straps, clean them up to get 'em out of the way. So Malone provides us with the bow and certain tie down straps. They are gonna be a stainless steel S hook. And if you didn't have a hood anchor or anything like that, you can always pick one up here at etrailer. Today, we are using a padded dog bone from our etrailer kayak carrier tie down strap kit. It just makes it a lot easier and we don't have to have any metal on frame contact. So we have it where we want it. So now we can just close the hood and attach our hook right here. So once we have our S hook hooked into our strap right here, we're just gonna pull tight. And then maybe around 15 inches or so, we're gonna make a loop, and then another loop. We're gonna wrap that around and then go back through in the middle. And then we are gonna take our free end over here and slide that through the back. Pulling on this side tight and then pulling down on my left. I'm just gonna go ahead and tie it off."
  • 'Thank you. The spray paint is holding up well.'
  • 'My C8 is black. I can say after 8 months, PPF holding up really good: knock on wood!'
8
  • 'your paint looks great, is it original? Looks super smooth'
  • 'Personally I prefer black mirror and everything else body color. That paint looks smoooth tho.'
  • "I used Adam's advanced graphene ceramic coat. It's billed as 10H and 9+ year durability. The kit was $140 on Amazon and i barely used a quarter of it. The paint feels smooth like glass. It's crazy."
0
  • 'VW Tiguan has been massacred by deep scratches, I have been experimenting with different pad combinations trying to remove the deep scratches.'
  • 'Black cars in general don’t hold their value as well as other colors due to black paint showing scratches and swirls extremely easily. These are not investment vehicles, at the end of the day they are economy Chrysler products made with very little concern for quality control.'
  • "I'm not sure why they went Gloss black on the GT front but matte on the EB. Glossy sucks to clean and scratches easily."
27
  • "First, it looks like your factory screen protector is still on the infotainment and I need to peel it off... Second, piano black interiors attract/show so much dust that you'd swear dust was manufactured by the trim. I keep a very small, tiny version of a California Duster in my car to tidy bits up. One end is like the duster, the other end is like a fat paint brush to get into crevices."
  • 'The reason we charge high dollar ppf prices is because we budget throw away materials for contamination like that. We run dust extraction machines like crazy in our install room. We also disassemble everything we can within reason we did a Hummer H2 custom bulk install on every panel and charged $15,000. Even at that price, we don’t look forward to doing another one. Customer was thrilled though.'
  • 'Natural wax is actually oil like and attracts dust and dirt particles (best shine tho) Synthetic sealants / hybrid wax or ceramic / graphene will repel elements.'
9
  • 'haha yea black is my color, esp with a glossy coat, love the look of shiny black & the vibrant red tail lights! the red is pretty cool too, i like the shade they have. I feel not all cars can pull off such a vibrant red!'
  • 'Hi All! The Bronco is ready for paint, and I’m torn between these three options. You guys have seen everything and I value your opinion from the heart. Was gonna do candy red but decided it’s too loud for this truck. Matte Graphite - looks insane irl and I think will pop with chrome and black accents. Every manufacturer is coming out with “special” satin/matte paints, and it’s super popular. I’ve always believed the bronco should be a nice glossy paint, and I’m truly happy with either option one or two. But then option three came in to derail my thought process. What do you find folks think would be a logical choice both in terms of aesthetic and maintenance?'
  • 'Nice look. The car is mirror like with that glossy finish. Wonderful looking Challenger'
3
  • 'I have a 22 Taos S 4motion. 40k miles. Pluses are that there car is reasonably comfortable and drives well. Decent mileage (28.6). With factory tires it’s been great in the snow. Plenty of room. Downsides - Paint is cracking (see previous post) and they will not cover (warranty on paint ends at 36k).'
  • 'Paint formulas changed drastically in 2007. They went from an oil base paint to water based, due to EPA regulations. Smaller rock chips, paint cracking, easier to scratch, etc. have gone up ever since.'
  • 'Thanks! It cost about $300 total. Same reason we repainted it… had too much cracked paint on the hood.'
12
  • "The driver's & front sides of the 235 stovebolt 6 engine has been painted blue as in a '56 Chevrolet blue flame engine out of a car (see pics before & after). It happens to be the identical type engine, i.e., from a Chevrolet car & born in 1956 that is in my other antique pick-up. I want the engine looking nice before it's dropped into the '52 Chevrolet Suburban Carryall."
  • 'Southeast Alabama . That is one awesome looking 90 model truck. I have a 1994 Chevrolet Silverado extended cab that I am and the shop and paint shop are trying kind of go back to factory or as close as we can . It is by no means a 1000 Horse power . Just the plain old 350- 5.7 Throttle body.'
  • 'I recently bought a 1987 Cadillac Brougham. Mechanically, it is in impeccable shape with only 41,000 original miles on the clock. The only issues are the bumper fillers (that I have replacements for), a few minor dings, and the paint.'
26
  • 'I’ve got a 2017 diesel Colorado and am happy with it stock emissions 147,000. One thing I learned: DOC is a wear part in addition to DPF. (There is no code for a bad oxidation catalyst just P200C high exhaust temps. I haven’t made master post about it on Coloradofans yet.) Anyway I’m happy but lots of information on chat rooms is confused and not always corrected by others who know. I like the Z71 better but do you ! !'
  • "Most recently used that trick on my cousin's 07 infiniti g37 and it blew his mind lol. As always follow up with your LSP of choice. I tried it on my old cadillac cts and it didn't even make a dent in the oxidation, had to break out the sand paper for that one. Thanks, looks like different plastic materials react differently. I wish we still have the good, old glass headlights."
  • 'Oxidation of the metal. It’s not shiny. Nor the cracks'
7
  • 'I’m not a big fan of the old F-150, but that paint is sharp, and I love that blue color.'
  • 'Wow, cool . I am the 3rd owner of a 2001 Ford Ranger Edge pickup, bright island blue metallic paint 131k miles and original paint. The truck still has 80% of its factory installed parts on it today. Not bad for a Maine vehicle.'
  • 'White, however, is the best and most long lasting color. I bought a 2005 Cadillac Deville (white), and the paint looks new. I have had other examples, the white is the most long lasting color as it does not absorb heat.'
14
  • 'I was eager to see what they were going to be but as a detail (hobby) guy, even for a garage go queen that paint is a no go. Really think this is a collector money grab. $15k is just too much for paint that is 8k on a Cadillac If you want it, GO FOR IT, but if you don't have the whole car wrapped in PPF, road debris is really going to do a number on it if that 15k doesn't include some extra mils and durability additive of paint. Not sure it will have a "clear" to polish out imperfections?'
  • 'That makes no sense and looks horrible. It may be painted but may also be removable. If someone just hand laid it on top of the clear coat, it may be able to be removed. The easy answer is just put a black vinyl stripe over it and forget it ever was there'
  • 'Originally Posted by SnakeEyeSS (Post 11325666) I was eager to see what they were going to be but as a detail (hobby) guy, even for a garage go queen that paint is a no go. Really think this is a collector money grab. $15k is just too much for paint that is 8k on a Cadillac If you want it, GO FOR IT, but if you don't have the whole car wrapped in PPF, road debris is really going to do a number on it if that 15k doesn't include some extra mils and durability additive of paint. Not sure it will have a "clear" to polish out imperfections?'
5
  • 'Both will be tough to keep clean. The gray will be more forgiving when it gets some swirls though. Only way I’d have a black car is if I had a garage to keep it in and it wasn’t my daily lol.'
  • 'Even when it’s dirty I find the phantom a bit more “forgiving” vs jet black/plain black. Hides it’s age a bit more too since the color is busier vs a straightforward, unforgiving black paint.'
  • "I've owned my share of black vehicles and I am too OCD to own them without spending an inordinate amount of time taking care of them. I'm a white, silver and maybe gunmetal grey guy now just because of the maintenance."
16
  • 'Color match. Now do the mirror caps and the door handles. If you decide to do the “bump strip on the doors, replace them. Don’t paint them. The paint doesn’t stick as well as you’d like in the long run on the plastic chrome.'
  • "2014 chevy equinox. There is a very slight shake at highway speed (75mph+) but when I hit the brakes my car turns into the paint mixer at home depot. I haven't noticed it with city driving, only highway."
  • "Personally, I've never worked on an Escalade but I've been around Cadillacs for a while. I was taught never to buy an old used Cadillac because of their engineering. If you want to take apart one thing, be prepared to take out everything. Parts are expensive, aluminum cracks and warps. In general I found Cadillacs to be engineering boobie traps with lots of spots to rip your arm open and scratch your hands. I guess that's just my opinion. You seem to like the challenges and I respect you for it."
24
  • "MY HD is stock, so no loud pipes. It shakes like a Home Depot paint mixer at idle, but silky smooth on the move. You'll love the Goldwing, just be careful in thinking that you're going from a Ford to a Cadillac in the comfort department."
  • 'Thoughts on leather conditioners - Apple Leather: puff up quilting about 2-3 applications but take care because it builds up shine, and to lube up stiff leather chain straps ?? - Saphir: gives life to dry grained leather and buffs out scratches - Cadillac: soft smooth leathers like lambskin and an all around mvp safe bet for all types of leather - Leather Honey: gives life to shoes, but ends tragically if used on grained leathers What are your thoughts?? Feel free to disagree / disprove the above!'
  • 'Same. Smooth that corner, apply touch up paint, call it a day. No one will see it'
1
  • 'Has the underground color and was commenting the other day about bad paint from the factory. I thought he was crazy until I went to look at one. Sure enough I went to the dealership and the black one I saw looked like it had already been through the car wash several times.'
  • 'There are known paint defects with Hyundai-Kia white paint. Assuming this is factory paint, you should contact Kia and push them to fix it'
  • 'My coworker has had his Fit painted 3 times due to shitty factory paint. It would all flake off near the window.'
11
  • 'Progressive, I had to fight for every dollar. They wanted to take $150 off the cash value they were paying for a tiny scuff mark in the interior plastic in the trunk area of the car, since it was a “pre-accident damageâ€x009d which was total bullshit.'
  • 'The Bronco Raptor is just as exotic or rare as your base model corvette. Not even a c8r. Calm down you didn’t scuff your shoes.'
  • 'They managed to get to her, and she suffered no serious injuries, save that her leg was scuffed pretty badly (blue and flathead catfish have no actual teeth, just a rough inner lip like sandpaper), but the experience was very traumatizing and made several newspapers and local TV news broadcasts (allegedly... I never saw this myself, despite my attempts in the past to find evidence for it). I've also spoken personally to several people who have claimed to do underwater work for the lakes in scuba gear (not sure what it is, save that it's got something to do with dam maintenance), and they have told me personally that they have seen catfish nesting at the foot of some dams that are "...the size of Buicks." Make of that how you will. There is also, of course, the ever-present rumor of the freshwater octopus in Oklahoma, but...can't say I have any experience with that one.'
6
  • "Tesla's paint quality isn't the best but if you've ever owned a Honda then you know the pain. Somehow Hyundai is one of the few car companies to figure out how to make really durable paint."
  • 'Hyundai puts a second coat of white paint on the car to make it more durable, hence the extra cost.'
  • "German cars and luxury cars in general will have significantly more durable paint. Honda on their speciality cars (e.g. CTR, NSX) will use harder paint. Aluminum bodied F series trucks and Audi’s usually have pretty solid paint. Mazda's speciality colors and Acura's $6k paint jobs are top notch"
4
  • ' I practiced on a 1990 Honda Accord that had neglected rough paint and had been sitting for 10 years. '
  • 'Probably done in shipping. It’s more hassle to get fixed than touch up paint. Had a scrape on my vehicle skirt. The paint issues that are worrisome are factory and usually take some time to appear as ripples, lines, or premature fading.'
  • 'Hey to all that have a hummer ev. I just took delivery and parked in garage. I noticed in the garage when light hits the right angle the reflection ripples like something is there.'
28
  • 'My 2018 was peeling when I got it brand new. Instead of having Chevy get me a new one, that would fail again I took some acetone to it to remove the remaining red. Then I bought sharpie paint pens and colored them yellow to match my calipers. Five years later the yellow is still perfect.'
32
  • 'Hey a little unrelated, but in my C8 (3LT) my leather dash is bubbling and delaminating. My dealer is taking care of it but why is this still an issue with the 3LTs even after being an issue for years on the C7? Is the glue they use different for the different leathers or something?'
25
  • 'I found a hummer EV with orange paint on the whole body like that!'
  • 'Oooo paint some engine block orange!'
  • 'I see some paint, was it orange or red paint originally?'
33
  • "We had to rescue a little male black-chinned hummer today. He had somehow managed to skewer a bug and got it stuck, holding his beak closed. We watched him for 2 days, trying to scratch and rub it, but just couldn't get it off."
  • "The Chevy Bolt in the chicken coop is to keep animals out, I bet. I have friends who own a Chevy Bolt, and twice they've had squirrels eat through the electrical wiring in their car. Apparently, the wires are wrapped in a soy-based coating that hungry animals like to nibble on."
35
  • 'Squatted, white, late model GMC 2500. Gasser, RWD, with the thinnest of tires. Painted on almost.'
  • 'Yes my rear seats ultimate leather is thinner than paper and is pealing away after 4 weeks owning a 2024 wtf. I want a lifetime warranty as long as I own the truck cheap cheap painted fake leather'
  • '"Alexa, put paint thinner on my shopping list."'
30
  • 'A good steam clean under carriage and some under coating it’s should be good as new'
  • 'Surface rust. A wire brush, some rust converter then chassis paint will make the frame look like new.'
  • 'I feel like Claptons "Cocaine" would be more appropriate with that pristine white paint and the t-tops'
17
  • 'I absolutely love the C8 in white. The paint matched side intake trim looks amazing, too. Excellent choice. 10/10.'
  • 'Acs in Canada has perfect carbon flash matching spoilers. I think they paint colors as well. Very high quality'
23
  • 'Theres no guarantee about the trans, got my 17 w/ 90k miles and still had to fix the shudder myself. Things to look for... Oil lines in engine bay (known to blow around 100k miles) Rust underneath All lighting, inside AND out. The center cluster is known to have dull lights/ bulbs (icons) Use the chair, rock back and forth and everything to see if anything falls short Every detail matters, inspect paint, edges, even under the bed (lot of dust and dirt collects under the tailgate)'
  • 'Idk how this came up on my feed. Nice paint combo. That town looks boring.'
  • 'What do you recomend for putting a coating on rubber mats. I hate how dull they look when youre done with a good detail.'
10
  • "I'd tape off the bottom of the bumper where it starts to taper down, conveniently where your scratches start....and I'd paint the entire bottom underside bumper black. So all the scratches will be covered in black, then add a splitter. No one would ever know except you. I'd use a decent quality spray paint and make sure to either remove the bumper from the car or get it high enough to cleanly spray the paint proper. 3 or 4 coats of black, couple coats of clear. Maaaybe"
  • 'What’s going on in pic 3? That looks bizarre!! How could that be missed before delivery. Might have a tougher time with the small interior scratch.'
  • 'I had a sweet ‘71 Chevy Blazer and some knuckleheads aggressively used a screwdriver to pry out the cheapest ‘97 Jensen CD player scratching up the original metal dash. Insult to injury - disc 4 from Bob Dylan’s box set ‘biograph’ was in there'
29
  • 'I am original owner of a 2001 Sierra 1500 SLE w/5.3L Z71 Have 152,000mi on it. It’s also part of the infamous cracked head list. The body and frame are in fantastic shape as is the original paint. No rust anywhere. I attribute this to maybe washing it 30x in its lifetime. :) Can I replace the engine with a newer LS or is it best to rebuild these? I’m not looking for massive power, just reliability.'
34
  • 'Wonder if it traps moisture under it or has any vibration that could cause paint wear. I love the looks of this tho!'
  • 'I bet it’s from the brushes. The finish on the paint does not like the rough brushes from car washes. When I got my bolt they told me absolutely do not take it to a car wash. Hand wash only or this could happen'
31
  • 'Customer service Ordered a new leer 100xr topper for my 2021 gmc. Waited over 2months for it to be built and when dealer installed it i noticed that the window gasket is half way out on one side and then there is a couple rough grinder marks on the lower edges. Not to mention when the dealer installed it they mounted it out of alignment and by the time i drove from dealer to my house it already rubbed the paint on the corner of my bedside above taillight completely off down to the bare metal.'

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("bhaskars113/toyota-paint-attribute-1.2")
# Run inference
preds = model("Oh and consider yourself blessed you got meteorite, I have sonic and swirl marks and scratches are so easily seen, with grey it hides much better")

Training Details

Training Set Metrics

Training set Min Median Max
Word count 2 46.2451 924
Label Training Sample Count
0 16
1 16
2 16
3 16
4 16
5 16
6 16
7 16
8 16
9 16
10 4
11 11
12 20
13 13
14 16
15 2
16 20
17 2
18 8
19 5
20 14
21 15
22 3
23 5
24 18
25 3
26 13
27 7
28 1
29 1
30 4
31 1
32 1
33 2
34 2
35 4

Training Hyperparameters

  • batch_size: (16, 16)
  • num_epochs: (1, 1)
  • max_steps: -1
  • sampling_strategy: oversampling
  • num_iterations: 20
  • body_learning_rate: (2e-05, 2e-05)
  • head_learning_rate: 2e-05
  • loss: CosineSimilarityLoss
  • distance_metric: cosine_distance
  • margin: 0.25
  • end_to_end: False
  • use_amp: False
  • warmup_proportion: 0.1
  • seed: 42
  • eval_max_steps: -1
  • load_best_model_at_end: False

Training Results

Epoch Step Training Loss Validation Loss
0.0011 1 0.1689 -
0.0563 50 0.2155 -
0.1126 100 0.139 -
0.1689 150 0.0656 -
0.2252 200 0.0359 -
0.2815 250 0.0462 -
0.3378 300 0.0182 -
0.3941 350 0.0235 -
0.4505 400 0.0401 -
0.5068 450 0.042 -
0.5631 500 0.0461 -
0.6194 550 0.0034 -
0.6757 600 0.0181 -
0.7320 650 0.0094 -
0.7883 700 0.0584 -
0.8446 750 0.0175 -
0.9009 800 0.0036 -
0.9572 850 0.0274 -

Framework Versions

  • Python: 3.10.12
  • SetFit: 1.0.3
  • Sentence Transformers: 2.7.0
  • Transformers: 4.40.2
  • PyTorch: 2.2.1+cu121
  • Datasets: 2.19.1
  • Tokenizers: 0.19.1

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}
Downloads last month
4
Safetensors
Model size
109M params
Tensor type
F32
·

Finetuned from