Hugging Face's logo
ben burtenshaw's picture
TFLOPS icon 14.2 TFLOPS
30 24 9

ben burtenshaw

burtenshaw
lunarflu's profile picture fpreiss's profile picture laloadrianmorales's profile picture
·

AI & ML interests

None yet

Recent Activity

upvoted an article about 14 hours ago
updated a dataset about 15 hours ago
burtenshaw/ohp-test-conversation
New activity 1 day ago
open-acc/README

Articles

Organizations

Hugging Face's profile picture Argilla's profile picture Blog-explorers's profile picture Argilla Explorers's profile picture distilabel-internal-testing's profile picture Data Is Better Together's profile picture Social Post Explorers's profile picture Hugging Face Discord Community's profile picture argilla-internal-testing's profile picture Open Human Feedback's profile picture Argilla Warehouse's profile picture open/ acc's profile picture

Posts 1

view post
Post
1418
SFT + Quantisation + Unsloth is a super easy way of squeezing extra performance out of an LLM at low latencies. Here are some hand y resources to bootstrap your projects.

Here's a filtered dataset from Helpsteer2 with the most correct and coherent samples: burtenshaw/helpsteer-2-plus
This is a SFT finetuned model: ttps://huggingface.co/burtenshaw/gemma-help-tiny-sft
This is the notebook I use to train the model: https://colab.research.google.com/drive/17oskw_5lil5C3jCW34rA-EXjXnGgRRZw?usp=sharing
Here's a load of Unsloth notebook on finetuning and inference: https://docs.unsloth.ai/get-started/unsloth-notebooks

Collections 3

Gemma HelpSteer
A work in progress collection of resources related to a project to finetune Gemma 2 2b for helpfulness with Helpsteer2.

Papers 1