Tokenizer Choice For LLM Training: Negligible or Crucial?
Paper
•
2310.08754
•
Published
•
2
German Research Center for Artificial Intelligence (DFKI)
non-profit
AI & ML interests
None defined yet.
Recent Activity
View all activity
DFKI's activity
malteos
authored
10
papers
16 days ago
Towards an Open Platform for Legal Information
Paper
•
2005.13342
•
Published
Aspect-based Document Similarity for Research Papers
Paper
•
2010.06395
•
Published
Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings
Paper
•
2202.06671
•
Published
•
2
Specialized Document Embeddings for Aspect-based Similarity of Research Papers
Paper
•
2203.14541
•
Published
Investigating Gender Bias in Turkish Language Models
Paper
•
2404.11726
•
Published
•
1
Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning
Paper
•
2301.09626
•
Published
•
2
Progress Report: Towards European LLMs
Paper
•
2410.03730
•
Published
•
2
Data Processing for the OpenGPT-X Model Family
Paper
•
2410.08800
•
Published
•
1
MMTEB: Massive Multilingual Text Embedding Benchmark
Paper
•
2502.13595
•
Published
•
31
simonost
authored
2
papers
17 days ago
LowREm: A Repository of Word Embeddings for 87 Low-Resource Languages Enhanced with Multilingual Graph Knowledge
Paper
•
2409.18193
•
Published
Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages
Paper
•
2502.10140
•
Published
•
9
DGurgurov
authored
2
papers
19 days ago
LowREm: A Repository of Word Embeddings for 87 Low-Resource Languages Enhanced with Multilingual Graph Knowledge
Paper
•
2409.18193
•
Published
Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages
Paper
•
2502.10140
•
Published
•
9
PSaiml
authored
a
paper
about 2 months ago
mbrack
authored
a
paper
3 months ago
PSaiml
authored
a
paper
3 months ago
DGurgurov
updated
3
models
3 months ago