Hugging Face's logo

Daxtra
/
sbert-summaries-minilm-128-batch

Sentence Similarity
sentence-transformers
Safetensors
bert
feature-extraction
Generated from Trainer
dataset_size:149248
loss:MultipleNegativesRankingLoss
Eval Results
text-embeddings-inference
Inference Endpoints
Model card Files Community
sbert-summaries-minilm-128-batch / README.md
Daxtra's picture
Daxtra
Add new SentenceTransformer model
b3245d0 verified
preview code
|
raw
history blame contribute delete
38.9 kB
---
base_model: sentence-transformers/all-MiniLM-L6-v2
library_name: sentence-transformers
metrics:
- cosine_accuracy@10
- cosine_precision@10
- cosine_recall@10
- cosine_ndcg@10
- cosine_mrr@10
- cosine_map@10
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:149248
- loss:MultipleNegativesRankingLoss
widget:
- source_sentence: '- Tax Accountant position, requiring a minimum of 5 years of accounting
experience with 2 years in public accounting preferred.
- Assist the Director of Finance in managing the general ledger and preparing
financial reports.
- Reconcile bank accounts, assist with month-end close, and coordinate capital
projections.
- Prepare tax returns, handle partners'' capital account reconciliations, and
coordinate tax workpaper preparation with external tax accountants.
- Requires an accounting degree.
- Proficiency in Microsoft Office, especially Excel and PowerPoint, is essential.'
sentences:
- '- Customer service professional with experience in sales, customer advising,
and inventory management.
- Experience in client services, client satisfaction, and effective communication
in a retail sales environment.
- Holds an Associate degree in Retail Sales and a Bachelor''s degree in Fashion
and Business.
- Proficient in cross-selling, credit card management, and problem-solving in
a fast-paced retail setting.
- Demonstrated skills in time management, teamwork, and meeting deadlines.
- Strong customer service skills and knowledge of global markets.
- Completed a National Cadet Core program; highly motivated and hardworking.'
- '- Experienced Special Events Producer with a strong background in event management
and production.
- Currently shadows the satellite team at Globe Cast UK Ltd, learning about media
distribution.
- Past roles include Booking Coordinator, managing schedules and coordinating
with satellite networks.
- Holds a Bachelor of Arts in Graphic Design and BTEC qualifications in Art &
Design.
- Proficient in Adobe Creative Suite and skilled in visual merchandising, social
media, and 3D modeling.
- Strong communication, decision-making, and organizational skills.'
- '- Finance professional with experience in accounting, finance, and financial
analysis roles across multiple industries in India.
- Recently served as Finance Controller, successfully managed accounting functions,
including payroll, tax compliance, and financial reporting, while reducing vendor
payment aging from 120 to 30 days.
- Improved revenue realization by implementing a close monitoring process with
the AR team, reducing DSO by 7 days.
- Holds an Executive Master''s in Business Administration and a Master''s in Accountancy,
with certification as a CPA.
- Strong skills in financial planning, budgeting, cost control, and analysis,
with experience in tax, accounts receivable, and payable management.
- Fluent in Tamil, Telugu, Hindi, and English; proficient in software like QuickBooks,
NetSuite, Tableau, and SAP.'
- source_sentence: '- Quality Assurance (QA) role, Entry-level, focusing on Java and
MySQL skills, with a requirement for a Bachelor''s Degree in Information Systems,
Computer Science, or related fields.
- Essential skills include a methodical and analytical mindset, hands-on software
development experience, and basic understanding of software development lifecycle
and automation.
- Must be able to handle evolving requirements and collaborate effectively with
teams to achieve common goals.
- Experience in financial industry and working with Big Data, SQL, and programming
languages like Java, Groovy, Perl, Python, JavaScript is desired.
- Requires proficiency in core Java (0-5 scale), with 0 years of experience necessary;
proficiency in Business Analysis is also required (0-5 scale).'
sentences:
- '- Investment Management Consultant with extensive experience in trading, client
relations, and risk management, achieving 100% trading accuracy.
- Manages client portfolios for capital growth aligned with risk tolerance, and
executes multi-leg option trades.
- Provides guidance on portfolio margin, intraday trading, and IRA rules; adept
at using Fidelity and Active Trader Pro.
- Proficient in fraud prevention, cybersecurity, and resolving complex financial
requests.
- Bachelor of Science in Accounting and CPQ certification.
- Experience includes roles in equities, fixed income, and corporate actions.
- Skills: Excel, PowerPoint, Word, Salesforce, and Microsoft Office suite.'
- '- CNC Programmer with experience in CNC milling and part production to AS9100
standards using various CNC machines.
- Responsibilities include CNC programming for first runs, maintenance, and housekeeping.
- Skills: CNC Programming, 5S Methodology, Quality Control, Lean Manufacturing,
CAD/CAM, Solidworks.
- Experience with machine parts from various materials.
- Certified in ISO 9001 and AS9100 standards.
- Proficient in decision-making, equipment selection, and lean manufacturing principles.'
- '- Full Stack Developer with 5 years of experience in Java/J2EE, Spring, and Node.js.
- Developed responsive JEE Web Applications using Java 17, Spring Framework, and
modern technologies.
- Expertise in Java 17 features (Lambda, Streams, etc.), Spring Framework features
(DI, Security, REST, etc.), and Spring Boot microservices.
- Proficient in Spring Boot, Spring Security, Spring REST, and Spring Integration.
- Experience with J2EE, Spring4, Spring Boot, and Java Persistence API (JPA) for
database operations.
- Skilled in designing applications with microservices architecture, using tools
like Docker, Kubernetes, and AWS.
- Strong background in web development, including HTML5, CSS3, and JavaScript,
with proficiency in Angular 14 and Angular.js.
- Excellent in Agile methodologies, with a track record in JIRA for defect reporting
and collaboration.'
- source_sentence: '- Chiller Technician with at least 5 years of experience in servicing
and repairing various types of chillers, including air-cooled, water-cooled, screw,
and centrifugal units.
- Responsibilities include comprehensive chiller maintenance, repair of large
RTUs, boiler and mechanical system repairs, and VRF systems troubleshooting.
- Requires EPA Universal Certification and experience with RTUs (20-200+ tons).
- Preferred: Manufacturer training and certifications from Trane, Carrier, York,
Daikin, or Mitsubishi.
- Must have strong troubleshooting skills, a clean driving record, and excellent
communication skills.
- Local candidate with a stable work history is required.'
sentences:
- '- Delivery and installation specialist with experience in security services and
account management.
- Recently promoted to accounts, responsible for collections and customer agreements.
- Previous roles include delivery driver, account manager, and security guard,
handling inventory and customer interactions.
- Skills: Microsoft Word, Microsoft Excel, customer service, inventory management,
and safe handling of deliveries.
- Educational background: High School Diploma.
- Additional experience: Cashier, Cook, Auto Detailer, and Transportation roles.'
- '- Aspiring Graduate Consultant with a strong background in data analytics, visualization,
and asset management.
- Experience as Operations Analyst includes liaising with 200+ customers weekly,
achieving a 95% resolution rate.
- Enhanced process efficiency by 25% and improved customer experience ratings
by 20% over eight months.
- Skilled in SQL, Python, Excel, Power BI, and Tableau, contributing to strategic
decision-making and operational efficiencies.
- Previous role as Business Analyst Manager, managing reporting and optimizing
strategies using Tableau.
- Supervised 15 interns and managed a 50:1 freelancer-to-project ratio with a
95% completion rate.
- Holds a Master''s Degree in Business Analytics and a Bachelor''s Degree in Technology
Electrical & Electronics Engineering.'
- '- Experienced HVAC Maintenance Supervisor with comprehensive industry experience
in maintenance, repair, and installation of HVAC systems.
- Lead HVAC Technician with expertise in building maintenance, heat pumps, and
water treatment.
- Proficient in troubleshooting, repair, and maintenance across various HVAC components.
- Certified in Building Management and Plumbing, with knowledge in central plant
operation.
- Skilled in high-voltage, mechanical, and office building maintenance.
- Experience as a Project Coordinator and Maintenance Technician.'
- source_sentence: '- Building Automation Service Technician role for candidates with
at least three years of experience in HVAC systems in commercial buildings, requiring
local presence and stable work history.
- Essential skills include BACnet, DDC controls, ALC, Allerton, Tritium, Niagara,
and DISTEC.
- Focus on commercial buildings and local candidates are preferred.'
sentences:
- '- Senior public affairs professional with extensive experience in global client
operations and executive search across financial sectors.
- Directed public affairs at The Parliamentary Review, managing production and
stakeholder engagement.
- Expertise in research methodologies, including comprehensive support on the
Equities Desk for top investment banks and hedge funds.
- Specialized in mapping CTA funds, impacting Dodd-Frank regulations, and developing
strategic plans in emerging markets.
- Bachelor of Arts in Politics, with strong analytical, financial management,
and stakeholder engagement skills.
- Previous roles include Public Affairs Director, Researcher, and Graduate Search
Assistant, with experience in event management and profit maximization.'
- '- Full Stack .NET Developer with 10+ years of experience in agile development
and test-driven development.
- Proficient in .NET technologies, including .NET 5.0, .NET Core, ASP.NET, MVC,
Angular, and TypeScript, with experience in UML diagrams and design patterns.
- Skilled in web service development with ASP.NET Web API, cloud computing (Azure),
and DevOps practices.
- Experience with AngularJS, React JS, Node JS, Azure Cosmos, and SQL Server 2014.
- Specialized in web services, microservices, and system integration for financial
systems.
- Strong background in SQL Server, Azure, and GIT for source code management.'
- '- Experienced Project Manager and Systems Specialist II with a strong background
in control systems installation, managing projects worth $3 million in the past
year.
- Oversees planning, design, installation, commissioning, and customer satisfaction
for projects, ensuring regulatory compliance and managing $3 million worth of
controls work.
- Skilled in bid management, subcontractor training, progress billing, and financial
management.
- Certified in Siemens, Johnson Controls, and Tridium systems; holds CPR and MCP
certifications.
- Proficient in Siemens Hardware, HVAC, Planned Maintenance, and network technologies
(LON, BACNET, MODBUS, Ethernet).
- Over 4 years of experience with Tridium Niagara AX and various software platforms
(Microsoft Windows, Microsoft Internet Server, Sage Peachtree).'
- source_sentence: '- Senior Business Development Executive with over 3+ years of
experience in business development or a related field, focusing on expanding client
businesses and maintaining strong relationships with MSPs and Resellers.
- Responsibilities include client-facing roles, strategic planning, lead generation,
CRM management using Pipedrive, market analysis, team collaboration, and reporting.
- Requires proven experience in client-facing roles and proficiency in lead generation,
closing deals, and using CRM tools.
- Strategic mindset and excellent communication, negotiation, and presentation
skills are essential.
- Bachelor''s degree in Business, Marketing, Sales, or a related field.'
sentences:
- '- Business Development Expert with over 4 years in financial services consulting
and B2B cold-calling, focusing on market analysis and stakeholder relationships.
- Current Role: Business Development Representative at Warehouse Club, achieving
a 40% increase in sales and maintaining optimal stock levels.
- Former Role: Brand Ambassador, leading 300% sales growth through persuasive
communication and product demonstrations.
- Skills: Leadership, communication, analytical, and stakeholder management.
- Certifications: ILSSI Lean Six Sigma Green Belt, Business Analyst-Transfer Pricing,
Taxation, and Financial Advisement.
- Education: Post-graduate with a Master of Science in Management and Bachelor
of Commerce.
- Interests: Project execution, FMCG, and financial services.'
- '- Senior Data/Informatica Engineer with over 15 years in IT, specializing in
Big Data/Cloud and Data Warehousing.
- Led IDMC migration projects, improving scalability and reducing operational
costs.
- Developed mappings for data integration, using Informatica for ETL tasks and
Python for advanced transformations.
- Skilled in Informatica parameter files, cloud transformations, and IDMC migration.
- Expertise in Python, Informatica, Teradata, GCP, BigQuery, and other data integration
tools.
- Experience in data migration, performance tuning, and cloud integration.
- Proficient in UNIX/Linux scripting for data processing.
- Expertise in handling GCP buckets, BQ, HDFS, and HBase.
- Strong skills in GIT, JIRA, Control M, BitBucket, Bamboo, and Informatica CICD.'
- '- Sales and Communication Analyst with experience in international relations
and media management.
- Managed Instagram content growth of 574 followers in 5 months at Young Amnesty
ESPOL.
- Organized events for African youth on neo-colonialism and Pan-Africanism.
- Master of Arts International Studies; Bachelor of Arts International Relations.
- Skills: Media Strategy, International Law, Problem Solving, and Social Media
Management.
- Experience with door-to-door sales, branding, and community outreach.'
model-index:
- name: SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
results:
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: vac res matcher
type: vac-res-matcher
metrics:
- type: cosine_accuracy@10
value: 0.37306201550387597
name: Cosine Accuracy@10
- type: cosine_precision@10
value: 0.07616279069767443
name: Cosine Precision@10
- type: cosine_recall@10
value: 0.11529940071242636
name: Cosine Recall@10
- type: cosine_ndcg@10
value: 0.12058166863177461
name: Cosine Ndcg@10
- type: cosine_mrr@10
value: 0.1943515826873384
name: Cosine Mrr@10
- type: cosine_map@10
value: 0.07246095764156223
name: Cosine Map@10
---
# SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) <!-- at revision ea78891063587eb050ed4166b20062eaf978037c -->
- **Maximum Sequence Length:** 128 tokens
- **Output Dimensionality:** 384 tokens
- **Similarity Function:** Cosine Similarity
<!-- - **Training Dataset:** Unknown -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 128, 'do_lower_case': False}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("Daxtra/sbert-summaries-minilm-128-batch")
# Run inference
sentences = [
"- Senior Business Development Executive with over 3+ years of experience in business development or a related field, focusing on expanding client businesses and maintaining strong relationships with MSPs and Resellers.\n- Responsibilities include client-facing roles, strategic planning, lead generation, CRM management using Pipedrive, market analysis, team collaboration, and reporting.\n- Requires proven experience in client-facing roles and proficiency in lead generation, closing deals, and using CRM tools.\n- Strategic mindset and excellent communication, negotiation, and presentation skills are essential.\n- Bachelor's degree in Business, Marketing, Sales, or a related field.",
'- Business Development Expert with over 4 years in financial services consulting and B2B cold-calling, focusing on market analysis and stakeholder relationships.\n- Current Role: Business Development Representative at Warehouse Club, achieving a 40% increase in sales and maintaining optimal stock levels.\n- Former Role: Brand Ambassador, leading 300% sales growth through persuasive communication and product demonstrations.\n- Skills: Leadership, communication, analytical, and stakeholder management.\n- Certifications: ILSSI Lean Six Sigma Green Belt, Business Analyst-Transfer Pricing, Taxation, and Financial Advisement.\n- Education: Post-graduate with a Master of Science in Management and Bachelor of Commerce.\n- Interests: Project execution, FMCG, and financial services.',
'- Senior Data/Informatica Engineer with over 15 years in IT, specializing in Big Data/Cloud and Data Warehousing.\n- Led IDMC migration projects, improving scalability and reducing operational costs.\n- Developed mappings for data integration, using Informatica for ETL tasks and Python for advanced transformations.\n- Skilled in Informatica parameter files, cloud transformations, and IDMC migration.\n- Expertise in Python, Informatica, Teradata, GCP, BigQuery, and other data integration tools.\n- Experience in data migration, performance tuning, and cloud integration.\n- Proficient in UNIX/Linux scripting for data processing.\n- Expertise in handling GCP buckets, BQ, HDFS, and HBase.\n- Strong skills in GIT, JIRA, Control M, BitBucket, Bamboo, and Informatica CICD.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```
<!--
### Direct Usage (Transformers)
<details><summary>Click to see the direct usage in Transformers</summary>
</details>
-->
<!--
### Downstream Usage (Sentence Transformers)
You can finetune this model on your own dataset.
<details><summary>Click to expand</summary>
</details>
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
## Evaluation
### Metrics
#### Information Retrieval
* Dataset: `vac-res-matcher`
* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator)
| Metric | Value |
|:--------------------|:-----------|
| cosine_accuracy@10 | 0.3731 |
| cosine_precision@10 | 0.0762 |
| cosine_recall@10 | 0.1153 |
| cosine_ndcg@10 | 0.1206 |
| cosine_mrr@10 | 0.1944 |
| **cosine_map@10** | **0.0725** |
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 149,248 training samples
* Columns: <code>sentence_0</code> and <code>sentence_1</code>
* Approximate statistics based on the first 1000 samples:
| | sentence_0 | sentence_1 |
|:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
| type | string | string |
| details | <ul><li>min: 47 tokens</li><li>mean: 116.19 tokens</li><li>max: 128 tokens</li></ul> | <ul><li>min: 54 tokens</li><li>mean: 119.22 tokens</li><li>max: 128 tokens</li></ul> |
* Samples:
| sentence_0 | sentence_1 |
|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| <code>- Public Relations Account Executive role for graduates with interest in media relations and corporate PR.<br>- Key responsibilities include researching media data, managing media relationships, drafting reports, and coordinating media features.<br>- Support client teams, manage social media, and contribute to SEO.<br>- Require a 2.1 degree from a leading university, preferably in Economics, Finance, Business, English, or Communications/Media.<br>- Strong understanding of financial and professional services industries.<br>- Essential skills: excellent writing, trend analysis, integrity, proactive teamwork, and leadership in account support.<br>- Previous PR experience is desirable.</code> | <code>- Experienced Social Media and Productions Manager with a Master’s in Digital Communication and Marketing.<br>- Led the creation of a multi-channel social media platform, generating Rs 900K annual revenue for a beauty brand.<br>- Managed digital asset creation for Palmolive Color Naturals, overseeing talent acquisition to post-production.<br>- Expertise in market segmentation, social media management, and post-production processes.<br>- Proficient in Microsoft Office, PowerPoint, Excel, and Adobe Suite; holds GCSE and O Levels in Math and Economics.<br>- Bilingual in Urdu and English; advanced knowledge in Advertising, Brand Marketing Strategy, and Public Relations.</code> |
| <code>- Fire/Safety Senior Sales Executive, requiring either 2-5 years of experience for Sr. Sales Executive or 5+ years for Account Executive.<br>- Responsible for developing sales strategies, managing contractor and end-user relationships, and executing sophisticated deals within established guidelines for fire and life safety in Iowa and Nebraska.<br>- Build scope development, develop proposals, interact with customers, and provide value through communication on product and installation risks.<br>- Coordinate estimating efforts and manage multiple projects.<br>- Develop a market understanding, identify new business opportunities, and position Siemens as a leader.<br>- Spend minimum 50% of time in customer-facing activities and travel 20% for training and business development.<br>- Required: High School Diploma or GED, 2+ years/5+ years experience, working knowledge of fire and life safety systems, and experience with building codes.<br>- Must be 21 years old and hold a valid driver's license.<br>- Preferred experience includes selling to contractors, design services, and experience in vertical markets.</code> | <code>- Experienced banking professional with over 7 years in Payments Coordination and Project Management.<br>- Currently seeking a role in Project Management, with strong skills in accurate and timely payment processing, customer service, and system monitoring.<br>- Proficient in handling customer inquiries, credit card fraud detection, and documentation processes.<br>- Holds a Master's Degree in Business Administration and Management, and a Bachelor's in Business.<br>- Certified Associate in Project Management (CAPM) and licensed insurance agent.<br>- Fluent in English, French, and proficient in ArcGIS, Microsoft Access, and various banking applications.</code> |
| <code>- Quality Assurance (QA) role, Entry-level, focusing on Java and MySQL skills, with a requirement for a Bachelor's Degree in Information Systems, Computer Science, or related fields.<br>- Essential skills include a methodical and analytical mindset, hands-on software development experience, and basic understanding of software development lifecycle and automation.<br>- Must be able to handle evolving requirements and collaborate effectively with teams to achieve common goals.<br>- Experience in financial industry and working with Big Data, SQL, and programming languages like Java, Groovy, Perl, Python, JavaScript is desired.<br>- Requires proficiency in core Java (0-5 scale), with 0 years of experience necessary; proficiency in Business Analysis is also required (0-5 scale).</code> | <code>- Test Automation Engineer with over 6 years of experience in Agile/Scrum environments, skilled in Java and Selenium WebDriver for web-based application testing.<br>- Developed test automation frameworks using Maven, JUnit, and Page Object Model design pattern.<br>- Proficient in Cucumber BDD features, steps, and runner packages for feature testing, as well as data-driven and cross-browser testing.<br>- Executed RESTful API testing with Postman and REST Assured, and database testing using SQL queries and JDBC.<br>- Expertise in test planning, test scripting, defect tracking, and test reporting using Jira Xray and other tools.<br>- Knowledgeable in Continuous Integration (CI/CD) and mentoring junior QA staff.<br>- Proficient in Java, Selenium, Cucumber, Maven, JUnit, Postman, REST Assured, MS Excel, SQL, and JDBC.</code> |
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `eval_strategy`: steps
- `per_device_train_batch_size`: 128
- `per_device_eval_batch_size`: 128
- `num_train_epochs`: 1
- `multi_dataset_batch_sampler`: round_robin
#### All Hyperparameters
<details><summary>Click to expand</summary>
- `overwrite_output_dir`: False
- `do_predict`: False
- `eval_strategy`: steps
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 128
- `per_device_eval_batch_size`: 128
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `torch_empty_cache_steps`: None
- `learning_rate`: 5e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1
- `num_train_epochs`: 1
- `max_steps`: -1
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.0
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: False
- `fp16`: False
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: False
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: False
- `hub_always_push`: False
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`:
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `dispatch_batches`: None
- `split_batches`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `eval_use_gather_object`: False
- `batch_sampler`: batch_sampler
- `multi_dataset_batch_sampler`: round_robin
</details>
### Training Logs
| Epoch | Step | Training Loss | vac-res-matcher_cosine_map@10 |
|:------:|:----:|:-------------:|:-----------------------------:|
| 0.0995 | 116 | - | 0.0684 |
| 0.1990 | 232 | - | 0.0699 |
| 0.2985 | 348 | - | 0.0711 |
| 0.3979 | 464 | - | 0.0720 |
| 0.4288 | 500 | 2.6358 | - |
| 0.4974 | 580 | - | 0.0697 |
| 0.5969 | 696 | - | 0.0721 |
| 0.6964 | 812 | - | 0.0714 |
| 0.7959 | 928 | - | 0.0717 |
| 0.8576 | 1000 | 2.373 | - |
| 0.8954 | 1044 | - | 0.0722 |
| 0.9949 | 1160 | - | 0.0724 |
| 1.0 | 1166 | - | 0.0725 |
### Framework Versions
- Python: 3.10.12
- Sentence Transformers: 3.2.1
- Transformers: 4.44.2
- PyTorch: 2.4.1+cu121
- Accelerate: 0.34.2
- Datasets: 3.0.1
- Tokenizers: 0.19.1
## Citation
### BibTeX
#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
```
#### MultipleNegativesRankingLoss
```bibtex
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->