wjunwei/ecommerce_text_embedding_retrieval

SentenceTransformer based on intfloat/e5-base-v2

This is a sentence-transformers model finetuned from intfloat/e5-base-v2. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: intfloat/e5-base-v2
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 tokens
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("wjunwei/ecommerce_text_embedding_retrieval")
# Run inference
sentences = [
    'baby hip carrier doctor recommendedbaby waist carrier hip seat all body typestoddler carrier for  lbs ergonomiceasy to put on ideal for handsfree parentinglumbar support grey approved by orthopedic doctors baby hip carrier is approved by orthopedic doctors ensuring safe and healthy baby carrying it puts your babys hips in the pediatricrecommended m position reducing painful spine curvature for both babies and grownups adaptable and longlastingtrexbabe hip seat grows with your little one it is suitable for newborns up to yearold toddlers or  lbs with four positions available  feeding side carrying front facing and face to face  you can easily adapt the carrier to your babys needs as they grow the baby carrier with hip seat provides additional support and comfort for both you and your baby back pain relief for caregiversour hip seat carrier is thoughtfully designed to distribute your babys weight evenly across your hips and waist relieving pressure on your back and shoulders say goodbye to backache and discomfort as our hip seat carrier for baby provides the support you need for longlasting comfort during extended outings or daily tasks the baby holder carrier is designed to prioritize your comfort as well lightweight  large storageweighing less than  pound the baby waist carrier hip seat is lightweight and convenient it also doubles as a diaper bag with large storage pockets eliminating the need for an extra bulky bag you can conveniently carry essential items such as diapers wipes and bottles while keeping your hands free the hip seat carrier offers a practical solution for parents on the go breathable  machine washable the soft and breathable fabric of our hip carrier allows for easy airflow ensuring your baby stays cool and comfortable the hip baby carrier is designed with both comfort and convenience in mind providing a breathable and easytoclean option for parents ',
    'patriotic tablecloth round  inch th of july table cloth washable spillproof wrinkle free blue red white independence day holiday fabric table cover for indoor outdoor kitchen dinning round tables material  polyester waterproof and spillproof fabric durablesoft stain resistantshrinkresistant and easy cleaning featurethis round patriotic tablecloth use fabric of water resistantstain resistanteasy cleaningcan use both indoor and outdoors size the round july th tablecloth measures  inch cmin diameter and the tablecloth would fits a  inch table occasion you can use indoor and outdoorespecially for bbqs parties picnicshost backyardholiday gatherings dinner with families and friends easy to care machine wash cold separately gentle cycle tumble dry low low iron if needed or spot with a damp cloth or sponge for simple cleanup',
    'gurunanda teeth whitening strips   treatments with  strips  professional enamelsafe strips for sensitive teeth  nonslip dry strip technology hydrogen peroxides whitening magic penetrates tooth enamel helping to break down stains  discoloration while coconuts soothing touch minimizes sensitivity ensuring a gentle whitening experience our strips offer superior adhesion for hasslefree application  stay put for up to  hours for effective whiter teeth for best results avoid eating sleeping or smoking while using the strips apply the strips daily for  minutes  see visible results in  days our kit consists of  strips professional  express for  treatments covering both upper  lower teeth for whitening experience noticeable effects in just  day with our  express whitening strips apply for  minutes daily to instantly brighten your smile use at home office during travelanytime anywhere our easytopeeloff strips effectively remove hard stains from coffee wine and smoking our product is enamelsafe vegan and crafted in an fdaregistered facility for a secure dental care routine',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Dataset

Unnamed Dataset

• Size: 3,200 training samples
• Columns: sentence_0, sentence_1, and label
• Approximate statistics based on the first 1000 samples:

  	sentence_0	sentence_1	label
  type	string	string	int
  details	min: 8 tokens mean: 217.15 tokens max: 512 tokens	min: 8 tokens mean: 217.72 tokens max: 512 tokens	0: ~87.50% 1: ~12.50%

• Samples:

  sentence_0	sentence_1	label
  usb c to lightning cable pack ft apple mfi certified iphone fast charger fast charging type c to lightning cable for iphone pro max xr xs and more quality and servicegherel usb c to lightning cable feet long convenient to charge your device in bedroom sofa office travel even if you are in the back seat of the car if you have any questions please feel free to contact us our service team will provide you with a satisfactory solution within hours apple mfi certified gherel apple mfi certified usb to lightning cableguaranteed no popup warning messages these iphone fast charger cables use the newest c lightning end design for fast charging which can safely and quickly charge your iphone device nylon braided the usb c to lightning cable is braided with nylon material for extra protection and durability braided nylon insulation and precision layered welded connectors make the cable more durable stronger and tanglefree than regular iphone charger cables rigorously tested over bends to withstand daily connection demands and longterm use quick charge data syncthe iphone charging cable adopts the latest mfi c lightning end which is specially designed for fast power supply which can charge your phone fast its charging speed is faster than ordinary lightning cables it also supports data transfer speeds of up to mbps to easily transfer music photos and files between iphone and macbook in seconds compatibilityusb c to iphone cable supports pd fast chargefor iphone pro pro max mini pro pro max mini pro pro maxxs maxxsxrx plus and iphone plus etc note you will need a usbc port wall charger for fast charging	usb c to lightning cable pack ft apple mfi certified iphone fast charger fast charging type c to lightning cable for iphone pro max xr xs and more quality and servicegherel usb c to lightning cable feet long convenient to charge your device in bedroom sofa office travel even if you are in the back seat of the car if you have any questions please feel free to contact us our service team will provide you with a satisfactory solution within hours apple mfi certified gherel apple mfi certified usb to lightning cableguaranteed no popup warning messages these iphone fast charger cables use the newest c lightning end design for fast charging which can safely and quickly charge your iphone device nylon braided the usb c to lightning cable is braided with nylon material for extra protection and durability braided nylon insulation and precision layered welded connectors make the cable more durable stronger and tanglefree than regular iphone charger cables rigorously tested over bends to withstand daily connection demands and longterm use quick charge data syncthe iphone charging cable adopts the latest mfi c lightning end which is specially designed for fast power supply which can charge your phone fast its charging speed is faster than ordinary lightning cables it also supports data transfer speeds of up to mbps to easily transfer music photos and files between iphone and macbook in seconds compatibilityusb c to iphone cable supports pd fast chargefor iphone pro pro max mini pro pro max mini pro pro maxxs maxxsxrx plus and iphone plus etc note you will need a usbc port wall charger for fast charging	1
  pelican protector pack apple airtag holder air tag case with m adhesive sticker rugged shockproof airtag cover hidden airtag holder stick on mount for travel luggage bike car remote black protective apple airtag holders our expertly designed apple airtag case securely holds your airtags with notches that amplify sound for easier detection through your iphone the apple tag holder fits snugly with an audible click is discreet is heavy duty to withstand movements vibrations ensuring your airtags stay secure whether biking traveling or running errands this pelican case air tag cover keeps your airtags hidden secure making it perfect for all your tracking needs premiumbuilt apple air tag case protect your air tags in style with our toptier air tags holder crafted from rugged pelican hard cases designed to withstand daily wear tear our airtags pack holder offers durability a perfect fit for your device the scratchresistant shockproof material of this itag holder ensures durability against bumps drops scratches upgrade your protection with our sleek pelican airtag holder blending lightweight design with reliable security robust m grip secure your apple airtags confidently with the true m supreme adhesive mount our adhesive airtag holder integrates the m vhb ensuring a strong grip on any smooth hard surface even during rigorous activities with precise cutouts discreet design our airtags case offers fulldevice protection without bulk use this apple tag case as an airtag holder for kids airtag holder for luggage airtag holder for car bike airtag holder or simply as an airtag holder for remote stick track done the pelican air tags case simplifies tracking by sticking onto hard surfaces of bikes electronics luggage backpacks drones cameras cars for efficient iphone gps tracking this makes our airtag holder pack set an essential accessory for vacations cruises travel more for best adhesion clean the surface before applying the apple airtag cover directly simplify setup with our innovative airtag holders that securely lock in place without tools or screws pelicanwarrantybacked quality explore our airtag case pack mounts from the protector series tailored specifically for apple airtags backed by a year warranty for peace of mind pelicans established protection legacy since extends to its air tag cases making them the top choice among divers firefighters police military personnel photographers worldwide questions about our apple tag holder please feel free to reach out	white backdrop curtains panels ft x ft photo polyester backdrop drapes for wedding party background decorations white backdrop curtains package including panels ft width by ft height polyester backdrop covering a total area of ft width by ft heightplease allow errors of ft polyester backdrop material made of high quality and wrinklefree polyester fabric with a inches rod pocket on the top for easy draping or hanging straight easy handling and carry wedding photo backdrop elegant display this party backdrop is perfect to create beautiful folds or leave it flowing loose onto the floor add a very soft beautiful romantic touch to your stage at any events photography background widely use perfect for weddings party stages ceremony receptions bridal and baby showers birthdays curtains products photo shoot portrait shooting youtube photo studio halloween daily use and other special decoration easy cleaning instructions this backdrop curtains is cleaned easily you can wipe the surface with a damp cloth its best to hand wash with warm water or machine wash in the gentle cycle with laundry bag no bleach lay flat or hang to dry can be used over and over again	0
  zealsea sheet mask skin care pack of beauty facial mask spa face mask birthday party gifts women men kids girls hydrate brighten moisturizesoothe for all skin types safe and effective ingredients zealsea facial sheet masks skincare with the most natural and active ingredients like aloe green tea honey vc orange avocado pomegranate and coffee face masks contains natural ingredients such as collagen and fruit extract that helps seal moisture in a safest way suitable for kids girls and women who need a safe way for skin care hydrated skin rich essence the premium natural adultkids skin care perfectly covers by curved area on face and make the skin evenly absorb the essence the mask brighten and hydrate the skin with hyaluronic acid and multivitamin essencethey are moderate thickness and not easily deformed gold proportion essence are nonsticky and instantly hydrates and refreshes highest quality cotton mask cloth our beauty face mask guarantee the highest quality the face masks skincare will be the best choice for your daily skin care using cotton mask cloth which is soft enough the mask does not fall the liquid essence will not drop and every drop of essence will not be wasted suitable for all skin types whatever your skin type is dry combination acne prone tired or aging our pack face sheet mask are your best choice oil alcohol free nonirritating for all skin types not contain talc paraben silicone synthetic color triethanolamine sodium sulfate bht benzophenonecrueltyfree veganfriendly if you have any problem with our products pls contact us we offer days free exchange or refund skincare facial mask beauty gift our face mask packs come in a minimum quantity of making each order a small spa party for you and your loved ones and it is good spa gifts for women family spa gift birthday party gift for herteengirls kids spa day party girls night best of holiday gifts and also refresh yourlifestyle after crazy party last night you can relax in a metime to get in your comfort zone destress urban damage	security camera wireless outdoor way talk battery powered wifi cameras for outside and indoor p night vision ai motion detection spotlight siren alarm ip weatherproof p hd security camera live video and full color night vision wideangle lens p ultrahd quality wifi camera dual light source night vision camera fullcolor night vision and infrared night vision are twoway options excellent lens and exquisite picture quality a wireless outdoor security camera will not miss a single detail not support g wifi wireless security camera and rechargeable battery wifi cam wireless outdoor camera with a builtin high performance rechargeable battery its a true lowpower consumption security camera for the home no need for any wires can be installed wherever you want indoor and outdoor scenes at a glance easy to install can adjust the angle or dismantle at will only work with ghz wifi intelligent pir motion detection and instant alerts security camera has a builtin infrared motion detection sensor any indication of movement within the target range will instantly send a notification to your phone via the vicohome app customizable monitoring range twoway talk and intelligent alarm builtin microphone and speaker no matter where you are you can talk to visitors couriers or callers at any time flashing white lights and sirens will drive away unwanted visitors the pir motion detection of the bullet camera is also triggered to record free day video history cloud storage and ip waterproof wireless security camera has dual storage mode support sd card and cloud storage double guarantee for your video free rolling past day cloud storage a day free trial of advanced features including upgraded cloud memory ai recognition and custom alarm areas the wireless security cam is protected by ip weatherproof technology secures your home despite rain snow and shine only work with ghz wifi	0

• Loss: ContrastiveTensionLoss

Training Hyperparameters

Non-Default Hyperparameters

• num_train_epochs: 5
• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: no
• prediction_loss_only: True
• per_device_train_batch_size: 8
• per_device_eval_batch_size: 8
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1
• num_train_epochs: 5
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.0
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: False
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• dispatch_batches: None
• split_batches: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: round_robin

Training Logs

Epoch	Step	Training Loss
1.25	500	7.8285
2.5	1000	4.1509
3.75	1500	3.685
5.0	2000	3.6183

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 3.0.1
• Transformers: 4.41.2
• PyTorch: 2.3.0+cu121
• Accelerate: 0.31.0
• Datasets: 2.20.0
• Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

ContrastiveTensionLoss

@inproceedings{carlsson2021semantic,
    title={Semantic Re-tuning with Contrastive Tension},
    author={Fredrik Carlsson and Amaru Cuba Gyllensten and Evangelia Gogoulou and Erik Ylip{"a}{"a} Hellqvist and Magnus Sahlgren},
    booktitle={International Conference on Learning Representations},
    year={2021},
    url={https://openreview.net/forum?id=Ov_sMNau-PF}
}