Ricardo Malagon Jerez's picture

6 6

Ricardo Malagon Jerez

rjmalagon

·

AI & ML interests

None yet

Recent Activity

reacted to mkurman's post with 🔥 18 days ago

We built a new small language model SmolLM2-MedIT-Upscale-2B, based on SmolLM2-1.7B-Instruct from Hugging Face. The premise was simple - increasing the vector in attention layers would positively impact the model's capabilities. What did we prove? In total, not much really, since we don't have the original trained under the same conditions as our upscale. However... 1. We scaled up the model without losing its quality 2. We confirmed that the method we devised works 3. After extremely short fine-tuning, the model achieved much better results in IFEval compared to the original (53.68 vs 64.29) and a higher overall average score in Open LLM Leaderboard (14.75 vs 15.17) I consider this a big success 😇, since surpassing the original in metrics is often very time-consuming, generates high costs, and doesn't always work out. Meanwhile, we're moving forward, training SmolLM2 400M Instruct as an upscale of 136M. We're curious about how increasing the base and intermediate vectors will affect the model's quality. We'll compare it to the original and the 360M Instruct version released by Hugging Face. License: Apache 2.0 https://huggingface.co/meditsolutions/SmolLM2-MedIT-Upscale-2B

reacted to clem's post with 👍 20 days ago

Hugging Face is becoming the best place to share the most viral AI apps with spaces. Kolors Virtual Try-on just crossed 6,000,000 unique visitors & is now the #5 most popular space. Congrats to the Kwai Kolors team! https://huggingface.co/spaces/Kwai-Kolors/Kolors-Virtual-Try-On

View all activity

Organizations

None yet

rjmalagon's activity

New activity in Alibaba-NLP/gte-Qwen2-1.5B-instruct 3 months ago

Qwen 2.5 1.5B retrain?

#12 opened 3 months ago by

New activity in Qwen/Qwen2.5-7B-Instruct 3 months ago

Less knowledge, maybe better reasoning versus Qwen2

#3 opened 3 months ago by

New activity in Danielbrdz/Barcenas-8b-Juridico-Mexicano 3 months ago

Disponible para Ollama

#1 opened 3 months ago by

New activity in Danielbrdz/Barcenas-14b-Juridico-Mexicano 3 months ago

Acceso via Ollama

#1 opened 3 months ago by

New activity in Danielbrdz/Barcenas-Llama3-8b-ORPO 3 months ago

Tuneados finos mexas, es bueno verle por aqui.

#3 opened 3 months ago by