metadata
base_model: intfloat/e5-base-v2
datasets: []
language: []
library_name: sentence-transformers
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:5864
- loss:ContrastiveTensionLoss
widget:
- source_sentence: >-
hp inch touchscreen laptop th generation intel core ig intel iris xe
graphics gb ram gb ssd windows home natural silver
sentences:
- >-
suposeu baby playpen play pen for kids activity center large baby
playard for indoor and outdoor sturdy safety baby fence with soft
breathable mesh for toddler grey suposeu baby playpen the x x inch
playpen can accommodate a large number of children toys and pets in
addition to providing plenty of room for play it provides a
scientifically safe height for babies aged months to months to train
stand and walk parents helper our baby playpens are useful for allowing
kids to play learn how to move independently and explore the world of
perception it protects them from getting lost or exposed to danger the
playpen can transform any space into a play area so parents can use
their unoccupied hands to take care of other things full vision design
the playpens side walls are composed of mesh that is both visible and
breathablethis seethrough mesh enables you to keep an eye on your boy or
girl and allows the baby to see you fostering comfort and safety the
external gate features a zipper design that allows for interaction with
your baby at any time thus instilling a sense of security in your baby
safety play area constructed with oxford fabric and robust steel pipe
this square infant playpen comes with sturdy suction cups at the bottom
making it difficult to tip over or move additionally our fence is
entirely covered in soft cloth leaving no exposed gaps which prevents
any pinching dangers easy to assemble super sturdy the baby fences pipes
are made of rustproof alloy with abs joints for easy assembly and
disassembly the bottom is made of nonslip breathable and quickdrying
fabric which can be cleaned by simply wiping it down with a wet cloth
and soap
- ' in charging station for apple devices mag safe charger standw fast magnetic charger wireless compatible for iphone promaxplusminiairpods proiwatch se mag safe charger stand features three charging spots designed for your iphone apple watch and airpods keeping your nightstand and desk at home or at work clutterfree after a long day your devices find a cozy home here getting charged up and ready for the morning compatible with iphone series iwatch ultra se and airpods pro with magnetic precision and strength enjoy handsfree convenience in both landscape and portrait mode this mag safe charger can power up your iphone pro max from to within the span of to hours as confirmed by lab testing mag safe charger is certified by rohs ce and fcc providing you the confidence to purchase worryfree the builtin improved intelligent chipset rest you assured with overcurrent overvoltage and overtemperature protection give you a safe and relible charging exeprience led light ring is designed for checking charging status making sure no more dead phone in the morning it also features a soft touch button to turn it off if you find the light annoying at night equipped with an ergonomic design and a sturdy base this magnetic phone charger creates a comfortable viewing angle for scrolling and bingewatching and maintains stability while charging compatible with iphone series iwatch ultra se and airpods pro treat your loved ones to a gift that combines functionality with style this sleek accessory that enhances any workspace or bedside table bringing a new level of convenience to your loved ones daily routine its a perfect christmas gift and stocking stuffers for men and women you enjoy months of warranty and feel free to reach out to us with any inquiries regarding our product were here to assist you promptly and effectively important note this charger is compatible solely with mag safe approved phone cases alternatively you can also charge your device without a phone case magnetic charger stand w qc adapter usb type c cablemft user manual'
- >-
uscce alarm clock bluetooth fm radio w stereo sound speaker fast
wireless charging for iphone samsung dimmable clock radio for bedroom
versatile multifunctional device bluetooth speaker alarm clock with w
fast wireless charger station builtin fm radio and color night light
exceptional audio quality enjoy superior sound with the w stereo
bluetooth speaker for a rich and immersive audio experience whether
youre streaming music listening to radio or sleeping with it powering
devices while you sleep convenient wireless charging and an extra usb
charging port ensure your devices are fully charged while you rest
display dimmer get your personal comfort brightness with full range
display dimmer slider without disturbing your sleep at night color
night light with adjustable brightness choose from seven vibrant colors
and adjust the brightness to create the perfect ambiance for any
occasion stylish modern design a combination of fabric and wooden finish
offers a contemporary and fashionable appearance adding a touch of
modern elegance to your surroundings
- source_sentence: >-
baby hair brush cradle cap brush baby hair comb baby hair brush and comb
set for newborns toddlers baby brush soft bristles ideal for cradle cap
perfect baby registry gift pink baby hair brush with the finest bristles
made from made of soft pp bristles bpa free you can softly brush your
babys hair and massage his scalp both for grooming and relaxation perfect
brush for a healthy cheerful baby baby hair comb the baby hair comb has
spherical teeth that wont pull or damage your babys hair or scalp
provides safe easy grooming experience prevent craddle cap by using the
soft bristle cradle cap brush daily to massage your babys scalp you can
prevent cradle cap from building up while also protecting their soft spot
extra safe for a super happy baby baby shower registry gift this baby
brush will cover every parents needs for grooming baby hair choose it for
your registry or buy one for your friends with babies everyone loves this
thoughtful practical gift satisfaction guarantee you and your baby will
love our product or you will receive a complete refund of your money take
advantage of our premium risk free offer now and buy your baby the best
grooming tools
sentences:
- >-
pyle wireless bluetooth home audio amplifier systemupgraded channel
watt sound power stereo receiver wusb micro sd headphone microphone
input wecho talkover for pa ptabt powerful watt the pyle channel
bluetooth home audio amplifier gives you w peak power which can be used
for multi speakers w ohms impedance allowing you to enjoy high quality
audio perfect for your pa and home theater entertainment bluetooth
capable the personal portable digital amp box works with todays latest
devices including smartphones tablets laptops and computers as it is
equipped with bluetooth wireless music streaming with hasslefree
receiver pairing multiple inputs the integrated indoor stereo receiver
supports ipod or mp usb micro sd aux playback builtin fm radio w digital
lcd display audio input and rec subwoofer output rca lr connectors also
features microphone inputs mic talkover function the professional
sound amplifying device features a mic talkover function which when
activated the current music or audio being played will be temporarily
halted this function is used in paging voiceover and announcements
integrated equalizer the compact amplifier has crisp buttons for the
audio sources and selectors rotary knob for equalization mic and master
volume adjustments a remote control is also included in the package for
distant audio adjustments
- >-
hair thinning scissors ulg professional barbers texturizing teeth shears
for hairdressing salon and home use thinning shears for hair cutting
made of japanese stainless steel inch premium material made from
japanese stainless steel hair thinning scissor with precise thinning
blades and handsharpened thinning edges to evenly trim hair with ease
high end design luxurious blue diamond stones in the twoleaf
intersection and mirror polish finish contains teeth on one blade and a
smooth razor edge on second multifunctional this thinning shear
measures inch with cutting blades that measure inch the professional
barber hair thinning scissor is safe and easy to use on men women the
elderly offset grip thumb handle is shorter than finger handle reduces
over extension of thumb and wrist motion relaxes your elbow and wrist
this type of handle has the best ergonomics what you get teeth
scissors and removable rubber handle inserts to fit any thumb and
finger with comfort grip month warranty for qualityrelated issues
- >-
handepo pcs bridal wedding gifts bridal bridesmaids robe sets with
sleeping eye mask slippers party tumbler tote gifts bridesmaid fluffy
fabric silk made in the china bridal party set package includes pair
pieces of pink bridesmaid slippers with bridesmaid and piece of
bridesmaid robe pc eye mask cup tote bag an ideal choice for bridal
shower bridesmaid night party bridal party sleeping bathing and lounging
let you shine at any time reliable material these bridesmaid slippers
are made of fuzzy plush fluffy fabric thickness and comfortable can
bring you a nice wearing experience the bridal party robes are made of
silk and are silky soft and smooth providing you with reliable comfort
after the bath or before going to bed thoughtful design these bridesmaid
slippers are embroidered to give you a soft dry touch without freezing
your feet even when outdoors the silk robe has a belt which makes it fit
well for a romantic wedding occasion meaningful ways to apply our womens
robes are suitable for wedding gifts bridal showers party gifts its also
a nice match for honeymoons trips and vacations its very memorable and
brings back precious memories for you one size the bridesmaid robes are
suit for most people and these bride slippers fit most us women tote bag
measures about x inches x cm the proper size is suitable for most
ladies and women to wear
- source_sentence: >-
senston badminton rackets set of graphite shaft badminton racquets
including badminton bag badminton shuttlecock racquet grip complete set
get everything you need to play badminton with family this badminton set
includes highquality badminton rackets nylon shuttlecocks random color
grips and a convenient carrying bag highquality material our badminton
racket is made of a carbonfiber alloy frame and graphite shaft making it
both lightweight and extremely durable youll enjoy the strength and
stability it provides during your games solid construction with a onepiece
design outside and a builtin tjoint inside our racket offers improved
stability and highprecision control performance youll feel confident and
in control on the court perfect for beginners whether youre new to the
game or just looking for some casual fun these rackets are perfect for you
for more advanced players check out our store for professionalgrade
rackets excellent customer service if you have any issues with your order
dont hesitate to contact us at any time
sentences:
- >-
hot wheels car rolling storage case with retractable handle model
conveniently store and carry up to hot wheels cars makes collecting and
clean up easy and fun measures x x kids ages and up
- >-
audiotechnica atlpxbtbk fully automatic bluetooth beltdrive stereo
turntable black hifi speed dust cover antiresonance diecast aluminum
platter fully automatic operation with speeds rpm and rpmwow and
flutter wtd at khz antiresonance diecast aluminum platter redesigned
tonearm base and headshell for improved tracking and reduced resonance
integral dual moving magnet phono cartridge with replaceable diamond
stylus atnl highfidelity audio with bluetooth wireless technology
compatible bluetooth profile adp
- >-
a pair of childrens bicycle riding flash silent training wheels suitable
for inch single speed bicycles huffy
- source_sentence: 'squishmallows pajamas girls short pajamas set pink '
sentences:
- >-
blush pink table runner hemstitch detail cotton ideal for spring
memorial day and summer solid hemstitch x inch perfect as ft table
linen cotton cotton hemstitch collection table runner made of cotton
fabric handwoven in a weight and texture perfectly suited for all
seasons measures x in size our dining table runner is inches wide and
inches long when laid centered and lengthwise our runner is long enough
to fit any standard size table comfortably and yet have enough cloth or
material hanging over the edges highquality table linen to enhance your
table setting perfect for rustic vintage or country look coordinating
placemats pair with our matching placemats to create the foundation for
a fun casual dining experience this table runner and placemat set can be
used for table dcor dressers sofa tables and coffee tables it is perfect
for everyday dinners parties holidays picnics brunches and barbeques
machine wash on gentle cycle and lay flat to dry for stress free care
sometimes the fabric doesnt lay flat after shipping use a warm iron with
steam and the wrinkles will come right out leaving you with a perfectly
flat and crisp table runner our offers an assortment of quality home and
kitchen products including tablecloths table runners cloth napkins
placemats dish towels visit our store to explore more
- 'kidscool space boys shortslittle big boys denim ripped summer shortalls '
- >-
williams lectric shave electric razor preshave ounce stands up whiskers
for a closer shave lets your razor glide for less friction and skin
irritation gives you a closer more comfortable shave and smoother skin
with soothing green tea complex blade close electric smooth
- source_sentence: >-
yeti yonder chug cap a bottle is only as good as its cap which is why we
brought the best parts of our rambler chug cap to the yonder cap
leakproof leakproof so you can carry it with confidence clippable slip
it through a backpack strap or clip it onto a carabiner to take water just
about anywhere dishwasher safe because no one needs more work to do spin
the top off when you need a drink from the controlled spout twist off the
bottom when youre ready to refill or wash it
sentences:
- >-
strapless prom dresses for women mermaid long sweetheart satin pleated
with high slit beaded evening gowns formal
- >-
lid for hydro flask oz wide mouth bottle replacement lid for
thermoflaskiron flasktakeya and more wide mouth bottles pack
compatibilitysuitable for hydro flaskshydroflaskthermoflaskiron
flasktakeyaklean kanteensimple modern hydro cellkoodeebjpkpk and more
brands wide mouth water bottlesplease confirm the mouth inner diameter
and thread height of the water bottle before purchase inner diameter
thread height important note this lid does not fit tal hydro flask
growler series hydropeak manna yeti nalgene ozark trail water bottles or
standard and narrow mouth water bottles when you are not sure please
feel free to contact us by email we will reply you in minutes during
working hours meanwhile we offer zerorisk purchase with a promise of
full refund or exchange soft handle the soft silicone handle and
flexible rotation design make it easy for you to carry a water bottle
even when filled with water simple and easy to replenish at any time
safe and leak proof bpa free healthy and safe eliminating leaks whether
you are undergoing safety checks or traveling keep your bag and clothes
dry classic style simple and atmospheric appearance design increases
the charm of your water bottle the simpler the more classic it is you
will love your water bottle more because of this replacement lid
- >-
hydro flask standard mouth lids accessory for standard mouth water
bottle standard mouth flex straw cap fits all hydro flask standard mouth
bottles straw is easy to trim to fit your favorite hydro flask flex
strap is easy to transport and comfortable to carry honeycomb insulated
cap for maximum temperature retention leakproof when closed so you can
reliably sip and transport your refreshment without worry bpafree
toxinfree removable components for easy cleaning dishwasher safe flex
straw cap not intended for use with hot liquids show more
SentenceTransformer based on intfloat/e5-base-v2
This is a sentence-transformers model finetuned from intfloat/e5-base-v2. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
Model Details
Model Description
- Model Type: Sentence Transformer
- Base model: intfloat/e5-base-v2
- Maximum Sequence Length: 512 tokens
- Output Dimensionality: 768 tokens
- Similarity Function: Cosine Similarity
Model Sources
- Documentation: Sentence Transformers Documentation
- Repository: Sentence Transformers on GitHub
- Hugging Face: Sentence Transformers on Hugging Face
Full Model Architecture
SentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
Usage
Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("wjunwei/ecommerce_text_embedding_retrieval_v2")
# Run inference
sentences = [
'yeti yonder chug cap a bottle is only as good as its cap which is why we brought the best parts of our rambler chug cap to the yonder cap leakproof leakproof so you can carry it with confidence clippable slip it through a backpack strap or clip it onto a carabiner to take water just about anywhere dishwasher safe because no one needs more work to do spin the top off when you need a drink from the controlled spout twist off the bottom when youre ready to refill or wash it',
'lid for hydro flask oz wide mouth bottle replacement lid for thermoflaskiron flasktakeya and more wide mouth bottles pack compatibilitysuitable for hydro flaskshydroflaskthermoflaskiron flasktakeyaklean kanteensimple modern hydro cellkoodeebjpkpk and more brands wide mouth water bottlesplease confirm the mouth inner diameter and thread height of the water bottle before purchase inner diameter thread height important note this lid does not fit tal hydro flask growler series hydropeak manna yeti nalgene ozark trail water bottles or standard and narrow mouth water bottles when you are not sure please feel free to contact us by email we will reply you in minutes during working hours meanwhile we offer zerorisk purchase with a promise of full refund or exchange soft handle the soft silicone handle and flexible rotation design make it easy for you to carry a water bottle even when filled with water simple and easy to replenish at any time safe and leak proof bpa free healthy and safe eliminating leaks whether you are undergoing safety checks or traveling keep your bag and clothes dry classic style simple and atmospheric appearance design increases the charm of your water bottle the simpler the more classic it is you will love your water bottle more because of this replacement lid ',
'hydro flask standard mouth lids accessory for standard mouth water bottle standard mouth flex straw cap fits all hydro flask standard mouth bottles straw is easy to trim to fit your favorite hydro flask flex strap is easy to transport and comfortable to carry honeycomb insulated cap for maximum temperature retention leakproof when closed so you can reliably sip and transport your refreshment without worry bpafree toxinfree removable components for easy cleaning dishwasher safe flex straw cap not intended for use with hot liquids show more',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
Training Details
Training Dataset
Unnamed Dataset
- Size: 5,864 training samples
- Columns:
sentence_0
,sentence_1
, andlabel
- Approximate statistics based on the first 1000 samples:
sentence_0 sentence_1 label type string string int details - min: 5 tokens
- mean: 145.16 tokens
- max: 512 tokens
- min: 3 tokens
- mean: 147.19 tokens
- max: 512 tokens
- 0: ~87.50%
- 1: ~12.50%
- Samples:
sentence_0 sentence_1 label squishmallows original inch bluey hugmees mediumsized ultrasoft official jazwares plush squad up grow your squishmallows squad with bluey a supersoft collectible mediumsized hugmees plush musthave bring the fun home with this squishmallows made with ultrasoft highquality materials hugmees squishmallows hugmees have extended arms and are always ready for a hug collectible look for other squishmallows extensions including flipamallows fuzzamallows mystery squad and stackables only by original squishmallows officially licensed product this inch plush is officially licensed by the bbc
squishmallows original inch bluey hugmees mediumsized ultrasoft official jazwares plush squad up grow your squishmallows squad with bluey a supersoft collectible mediumsized hugmees plush musthave bring the fun home with this squishmallows made with ultrasoft highquality materials hugmees squishmallows hugmees have extended arms and are always ready for a hug collectible look for other squishmallows extensions including flipamallows fuzzamallows mystery squad and stackables only by original squishmallows officially licensed product this inch plush is officially licensed by the bbc
1
rechargeable headlamp high lumen bright led head lamp with red white light ipx waterproof headlight mode head flashlight for outdoor running hunting fishing hiking camping gear illuminate your world in all directions designed in the usa mioisy head lamp features powerful xpgled bulbs that provide up to lumens max ensuring that you can see everything around you clearly perfect for exploring caves night runningcyclingfishingcamping construction work and other outdoor adventure activities the red safety warning light switch is located on the back battery compartment to ensure all direction safety and emergency response usb rechargeable and long battery life do not use unsafe cylindrical batteries our rechargeable headlamp usa builtin rechargeable batteries to ensure your safety first our head lamps support typec usb charging making it convenient for everyday use the headlamp rechargeable can provide hours of longlasting power in different lighting modes so you can adventure without worrying about running out of juice long press and motion sensor in any mode press the on switch button for seconds the rechargeable headlamp flashlight will turn off directly no need to cycle through all the modes the headlights for head is also equipped with the smart motion sensor which easily controls the headlamps for adults on and off with a wave of your hand more convenient for your work ipx waterproof and modes for any situation our headlamp flashlight is built to withstand splashes of water from all angles so you can take it on any weather rain or shine the head light has modes controlled by buttons one button switch key modes the other button switch sensor modes our led headlamp is the ultimate adaptable tool for any situation ensuring you have the right light for any adventure adjustable angle and comfortable headband to ensure flexible lighting our head lights for forehead can be adjusted and the handsfree headlamp provides bright and steady lighting while you work the headlights for head use a soft and comfortable elastic headband that can be adjusted to fit different head size perfect headlamps for adults and kids only weight oz its comfortable to wear for long time ensuring you can explore with easethe band can be taken off to wash perfect gift for any occasion whether its fathers day thanksgiving christmas valentines day easter halloween or any special festival our rechargeable head flashlight is the perfect gift for anyone who loves the outdoor adventure give your father mother husband son or boyfriend the great gift with our powerful and reliable led headlamps if you have any questions please reach out to us to get professional solutions
ocyclone tablet stand ipad stand for desk adjustable height and angle foldable tablet holder stand compatible with portable monitor ipad pro air mini black wide compability ocyclone tablet holder stand works with all inches smartphones and most tablets with cases such as ipad pro ipad air ipad ipad mini samsung galaxy tabs surface surface pro kindle fire hd portable monitor drawing tablet height angle adjustable the height of the tablet stand holder can be simply adjusted the angle can be adjusted from to by hand with this ocyclone tablet holder you can enjoy your movies cooking reading studying playing games watching youtube without any worries providing you comfortable viewing angle which helps to fix your posture and reduce neck back ache hands free portable the foldable design of the ipad stand makes you easy to carry your phone and ipad everywhere you can put the stand in the bag or on the body undoubltly it is a great ideal accessories for you take it any place of course it is also a great ideal gift for your family or your friends they will definitely be satisfied with the portable tablet stand super sturdy fully protective silicone pad ocyclone desk tablet ipad stand with premium aluminum abs material makes it more durable than others quality nonskid rubber covered on the front and the bottom can mamximum protect your phone from slide and scratches you can easily tap the screen without worrying the devices will tip over or fall off friendly user design the reserved charging hole makes it more convenient to charge your devices while using this tablet phone holder in addtion the silicone hook pad will not cover the subtitle when you watching movies ocyclone always aims at providing our customers the best happy shopping experience if you have any confusing please get in touch with us we will answer you within hours
0
colgate extra soft toothbrush for sensitive teeth and gums with tongue and cheek cleaner pack extra soft toothbrush for sensitive teeth softer bristles protect tooth enamel and gums vs an ordinary soft manual toothbrush polishing cups gently remove teeth stains to whiten teeth our unique tongue and cheek cleaner remove bad breath bacteria raised cleaning tip helps get into hard to reach areas
water bottle stickers pcs cool neon stickers sticker pack for kids adults teens waterproof vinyl stickers stickers for laptop skateboard journal notesbook computer phone cup guitar luggage etc great variety sticker pack contains pieces mix neon stickers designed to be friendly healthy and nonrepetitive cool neon and fun patterns add a unique eyecatching flair to your bland items make your life more colorful funny gifts neon stickers have a unique visual effect injecting brilliant and cool colors and trendy vitality into life stickers for adults teens kids and stickers lovers stickers can be used as birthday gifts party favors home or classroom behavior rewards etc good quality beautiful vinyl stickers size in waterproof design bright colors and high resolution good sticking power no fading no unhealthy motifs not easy to tear safe and nontoxic even outdoors it can easily handle inclement weather widely used fun stickers can not only cover or embellish items so you can feel the fun and delightful emotions that come with decoration stickers for water bottle laptop journal scrapbook computer skateboard phone case macbook ipad planner cups suitcase luggage notebook scooter bike etc simple to use reusable stickers made with nonmarking adhesive can be randomly pasted or torn off without hurting the surface no residue is left behind when replacing or peel light up life all it takes is a cool and fun neon stickers brand stickers airnogo every product is carefully checked to ensure perfection if you have any questions we will take care of it immediately until you are satisfied
0
- Loss:
ContrastiveTensionLoss
Training Hyperparameters
Non-Default Hyperparameters
num_train_epochs
: 5multi_dataset_batch_sampler
: round_robin
All Hyperparameters
Click to expand
overwrite_output_dir
: Falsedo_predict
: Falseeval_strategy
: noprediction_loss_only
: Trueper_device_train_batch_size
: 8per_device_eval_batch_size
: 8per_gpu_train_batch_size
: Noneper_gpu_eval_batch_size
: Nonegradient_accumulation_steps
: 1eval_accumulation_steps
: Nonelearning_rate
: 5e-05weight_decay
: 0.0adam_beta1
: 0.9adam_beta2
: 0.999adam_epsilon
: 1e-08max_grad_norm
: 1num_train_epochs
: 5max_steps
: -1lr_scheduler_type
: linearlr_scheduler_kwargs
: {}warmup_ratio
: 0.0warmup_steps
: 0log_level
: passivelog_level_replica
: warninglog_on_each_node
: Truelogging_nan_inf_filter
: Truesave_safetensors
: Truesave_on_each_node
: Falsesave_only_model
: Falserestore_callback_states_from_checkpoint
: Falseno_cuda
: Falseuse_cpu
: Falseuse_mps_device
: Falseseed
: 42data_seed
: Nonejit_mode_eval
: Falseuse_ipex
: Falsebf16
: Falsefp16
: Falsefp16_opt_level
: O1half_precision_backend
: autobf16_full_eval
: Falsefp16_full_eval
: Falsetf32
: Nonelocal_rank
: 0ddp_backend
: Nonetpu_num_cores
: Nonetpu_metrics_debug
: Falsedebug
: []dataloader_drop_last
: Falsedataloader_num_workers
: 0dataloader_prefetch_factor
: Nonepast_index
: -1disable_tqdm
: Falseremove_unused_columns
: Truelabel_names
: Noneload_best_model_at_end
: Falseignore_data_skip
: Falsefsdp
: []fsdp_min_num_params
: 0fsdp_config
: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}fsdp_transformer_layer_cls_to_wrap
: Noneaccelerator_config
: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}deepspeed
: Nonelabel_smoothing_factor
: 0.0optim
: adamw_torchoptim_args
: Noneadafactor
: Falsegroup_by_length
: Falselength_column_name
: lengthddp_find_unused_parameters
: Noneddp_bucket_cap_mb
: Noneddp_broadcast_buffers
: Falsedataloader_pin_memory
: Truedataloader_persistent_workers
: Falseskip_memory_metrics
: Trueuse_legacy_prediction_loop
: Falsepush_to_hub
: Falseresume_from_checkpoint
: Nonehub_model_id
: Nonehub_strategy
: every_savehub_private_repo
: Falsehub_always_push
: Falsegradient_checkpointing
: Falsegradient_checkpointing_kwargs
: Noneinclude_inputs_for_metrics
: Falseeval_do_concat_batches
: Truefp16_backend
: autopush_to_hub_model_id
: Nonepush_to_hub_organization
: Nonemp_parameters
:auto_find_batch_size
: Falsefull_determinism
: Falsetorchdynamo
: Noneray_scope
: lastddp_timeout
: 1800torch_compile
: Falsetorch_compile_backend
: Nonetorch_compile_mode
: Nonedispatch_batches
: Nonesplit_batches
: Noneinclude_tokens_per_second
: Falseinclude_num_input_tokens_seen
: Falseneftune_noise_alpha
: Noneoptim_target_modules
: Nonebatch_eval_metrics
: Falsebatch_sampler
: batch_samplermulti_dataset_batch_sampler
: round_robin
Training Logs
Epoch | Step | Training Loss |
---|---|---|
0.6821 | 500 | 7.9052 |
1.3643 | 1000 | 4.3803 |
2.0464 | 1500 | 3.6253 |
2.7285 | 2000 | 3.6853 |
3.4106 | 2500 | 3.6878 |
4.0928 | 3000 | 3.602 |
4.7749 | 3500 | 3.6512 |
Framework Versions
- Python: 3.10.12
- Sentence Transformers: 3.0.1
- Transformers: 4.41.2
- PyTorch: 2.3.0+cu121
- Accelerate: 0.31.0
- Datasets: 2.20.0
- Tokenizers: 0.19.1
Citation
BibTeX
Sentence Transformers
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
ContrastiveTensionLoss
@inproceedings{carlsson2021semantic,
title={Semantic Re-tuning with Contrastive Tension},
author={Fredrik Carlsson and Amaru Cuba Gyllensten and Evangelia Gogoulou and Erik Ylip{"a}{"a} Hellqvist and Magnus Sahlgren},
booktitle={International Conference on Learning Representations},
year={2021},
url={https://openreview.net/forum?id=Ov_sMNau-PF}
}