81 73 254

Alvaro Bartolome

alvarobartt

https://alvarobartt.github.io/

alvarobartt

AI & ML interests

ml @argilla / open-source and machine learning

Articles

💨 Introducing Notus: a DPO fine-tune of Zephyr with a focus on high-quality data

Dec 1, 2023

• 1

🤗 LLM suggestions in Argilla with HuggingFace Inference Endpoints

Sep 20, 2023

Organizations

alvarobartt's activity

upvoted a collection 1 day ago

em🍞ing series

Collection

crispy sentence embedding family • 3 items • Updated Mar 28 • 17

upvoted 4 papers 4 days ago

OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework

Paper • 2405.11143 • Published 13 days ago • 33

Aya 23: Open Weight Releases to Further Multilingual Progress

Paper • 2405.15032 • Published 9 days ago • 21

Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models

Paper • 2405.15574 • Published 8 days ago • 45

NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models

Paper • 2405.17428 • Published 5 days ago • 12

upvoted an article 4 days ago

Article

Training and Finetuning Embedding Models with Sentence Transformers v3

5 days ago

• 60

upvoted 2 collections 9 days ago

Creación de corpus en comunidad

Collection

Colección de esfuerzos colaborativos para crear corpus en español de calidad. Toda persona hispanohablante puede contribuir :) • 7 items • Updated 26 days ago • 6

C4AI Aya 23

Collection

Aya 23 is an open weights research release of an instruction fine-tuned model with highly advanced multilingual capabilities. • 3 items • Updated 9 days ago • 34

upvoted an article 10 days ago

Article

Deploy models on AWS Inferentia2 from Hugging Face

11 days ago

• 12

upvoted a collection 18 days ago

Critique Models (CM) on the 🤗 Hub

Collection

This collection contains some Critique Models (CM) for LLM evaluation available in the HuggingFace Hub • 5 items • Updated 26 days ago • 3

upvoted a paper 30 days ago

Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models

Paper • 2405.01535 • Published about 1 month ago • 102

upvoted 2 collections about 1 month ago

SystemChat Preferences

Collection

This collection contains the results of the effort on extending `abacusai/SystemChat-1.1` to convert it into a preference dataset • 12 items • Updated Apr 30 • 1

Capybara Preferences

Collection

This collection contains the results of the effort on extending `LDJnr/Capybara` to convert it into a preference dataset, with 7B LLMs • 8 items • Updated Apr 17 • 1

upvoted 2 papers about 1 month ago

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

Paper • 2404.18796 • Published Apr 29 • 63

Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Data

Paper • 2404.14367 • Published Apr 22 • 1

upvoted an article about 1 month ago

Article

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Apr 22

• 73

upvoted 5 papers about 1 month ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 238

Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study

Paper • 2404.10719 • Published Apr 16 • 3

Best Practices and Lessons Learned on Synthetic Data for Language Models

Paper • 2404.07503 • Published Apr 11 • 25

Pre-training Small Base LMs with Fewer Tokens

Paper • 2404.08634 • Published Apr 12 • 32

Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length

Paper • 2404.08801 • Published Apr 12 • 62

upvoted an article about 1 month ago

Article

Fine-tune Llama 3 with ORPO

•

Apr 22

• 193

upvoted a collection about 1 month ago

Meta Llama 3

Collection

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated Apr 18 • 557

upvoted an article about 2 months ago

Article

Making thousands of open LLMs bloom in the Vertex AI Model Garden

Apr 10

• 16

upvoted a collection about 2 months ago

Zephyr ORPO

Collection

Models and datasets to align LLMs with Odds Ratio Preference Optimisation (ORPO). Recipes here: https://github.com/huggingface/alignment-handbook • 3 items • Updated Apr 12 • 14

upvoted 2 papers about 2 months ago

LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders

Paper • 2404.05961 • Published Apr 9 • 62

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2 • 102

upvoted an article about 2 months ago

Article

Hugging Face and Google partner for open AI collaboration

Jan 25

• 2

upvoted a collection 2 months ago

Qwen1.5

Collection

Qwen1.5 is the improved version of Qwen, the large language model series developed by Alibaba Cloud. • 55 items • Updated 20 days ago • 183

upvoted a paper 2 months ago

sDPO: Don't Use Your Data All at Once

Paper • 2403.19270 • Published Mar 28 • 31

upvoted a collection 2 months ago

Foundation AI Papers

Collection

Curated List of Must-Reads on LLM reasoning at Temus AI team • 134 items • Updated Apr 29 • 22

upvoted a paper 2 months ago

Long-form factuality in large language models

Paper • 2403.18802 • Published Mar 27 • 23

upvoted 3 collections 2 months ago

Recent Mamba Papers

Collection

[NB: Notes are from TuringPost] • 3 items • Updated Mar 26 • 8

About ORPO

Collection

Contains some information and experiments fine-tuning LLMs using 🤗 `trl.ORPOTrainer` • 8 items • Updated 26 days ago • 5

ORPO

Collection

This is the official collection of "ORPO: Monolithic Preference Optimization without Reference Model". • 5 items • Updated Apr 12 • 10

upvoted a paper 2 months ago

ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 58

upvoted 2 collections 3 months ago

Deita

Collection

14 items • Updated 13 days ago • 8

Zephyr 7B Gemma

Collection

Models, dataset, and Demo for Zephyr 7B Gemma. For code to train the models, see: https://github.com/huggingface/alignment-handbook • 5 items • Updated Apr 12 • 15

upvoted 2 papers 3 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 125

Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models

Paper • 2402.17177 • Published Feb 27 • 87

upvoted a collection 3 months ago

💫 StarCoder2

Collection

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 74

upvoted a paper 3 months ago

Multi-LoRA Composition for Image Generation

Paper • 2402.16843 • Published Feb 26 • 28

upvoted a collection 3 months ago

Gemma release

Collection

Groups the Gemma models released by the Google team. • 40 items • Updated 18 days ago • 305

upvoted a collection 4 months ago

OLMo Suite

Collection

Artifacts for the first set of OLMo models. • 12 items • Updated 17 days ago • 36

upvoted 6 papers 5 months ago

Understanding LLMs: A Comprehensive Overview from Training to Inference

Paper • 2401.02038 • Published Jan 4 • 59

TinyLlama: An Open-Source Small Language Model

Paper • 2401.02385 • Published Jan 4 • 81

Mixtral of Experts

Paper • 2401.04088 • Published Jan 8 • 152

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Paper • 2312.11514 • Published Dec 12, 2023 • 253

Improving Text Embeddings with Large Language Models

Paper • 2401.00368 • Published Dec 31, 2023 • 73

Some things are more CRINGE than others: Preference Optimization with the Pairwise Cringe Loss

Paper • 2312.16682 • Published Dec 27, 2023 • 4

upvoted a collection 5 months ago

Notux 8x7B v1

Collection

Notux 8x7B v1 model (DPO fine-tune of Mixtral 8x7B Instruct v0.1) and datasets used. More information at https://github.com/argilla-io/notus • 6 items • Updated Dec 29, 2023 • 7

upvoted a paper 5 months ago

SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling

Paper • 2312.15166 • Published Dec 23, 2023 • 55

upvoted 2 collections 5 months ago

Apple MLX-compatible 7B LLMs on the 🤗 Hub

Collection

This collection contains the model weights for 7B LLMs for Apple's MLX framework. Find more information at https://github.com/ml-explore/mlx • 8 items • Updated 26 days ago • 9

Datasets based on UltraFeedback

Collection

This collection contains some datasets created on top of UltraFeedback using Argilla for the dataset exploration and curation, sorted by release date. • 6 items • Updated Mar 19 • 10

upvoted a paper 6 months ago

Prometheus: Inducing Fine-grained Evaluation Capability in Language Models

Paper • 2310.08491 • Published Oct 12, 2023 • 50

upvoted 4 collections 6 months ago

PEFT papers

Collection

A collection of methods that have been implemented in the 🤗 PEFT library • 12 items • Updated Jan 30 • 15

Preference Datasets for DPO

Collection

This collection contains a list of curated preference datasets for DPO fine-tuning for intent alignment of LLMs • 7 items • Updated Apr 4 • 20

Recent models: last 100 repos, sorted by creation date

Collection

The last 100 repos I have created. Sorted by creation date descending, so the most recently created repos appear at the top. • 121 items • Updated Jan 31 • 447

Notus 7B v1

Collection

Notus 7B v1 models (DPO fine-tune of Zephyr SFT) and datasets used. More information at https://github.com/argilla-io/notus • 11 items • Updated Dec 28, 2023 • 17

upvoted a paper 6 months ago

The Falcon Series of Open Language Models

Paper • 2311.16867 • Published Nov 28, 2023 • 11

Alvaro Bartolome

AI & ML interests

Articles

🧑‍⚖️ "Replacing Judges with Juries" using distilabel

Deploying 🤗 Hub models in Vertex AI

🏷️ Build AI Feedback (AIF) datasets for LLM alignment with ⚗️ distilabel

💨 Introducing Notus: a DPO fine-tune of Zephyr with a focus on high-quality data

🤗 LLM suggestions in Argilla with HuggingFace Inference Endpoints

Organizations

alvarobartt's activity

Training and Finetuning Embedding Models with Sentence Transformers v3

Deploy models on AWS Inferentia2 from Hugging Face

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Fine-tune Llama 3 with ORPO

Making thousands of open LLMs bloom in the Vertex AI Model Garden

Hugging Face and Google partner for open AI collaboration