Team Hydrogen

community

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

ybabakhin authored a paper 11 months ago

H2O-Danube-1.8B Technical Report

ilu000 authored a paper 11 months ago

H2O-Danube-1.8B Technical Report

psinger authored a paper 11 months ago

H2O-Danube-1.8B Technical Report

View all activity

TeamHydrogen's activity

psinger

posted an update 9 months ago

Post

2083

Releasing H2O-Danube2-1.8b - a new and improved language model being the current top model on the Open LLM Leaderboard.

The model is trained on additional 2T tokens (total of 3T tokens) with various data mix stages as a result of extensive experimentation. Focus is on natural language tasks.

Base weights: h2oai/h2o-danube2-1.8b-base
SFT weights: h2oai/h2o-danube2-1.8b-sft
Chat weights: h2oai/h2o-danube2-1.8b-chat

psinger

posted an update 11 months ago

Post

Happy to share H2O-Danube-1.8b, a small 1.8b model based trained on only 1T natural language tokens showing competitive metrics across benchmarks in the <2B model space.

Base weights: h2oai/h2o-danube-1.8b-base
Chat weights: h2oai/h2o-danube-1.8b-chat
Technical report: H2O-Danube-1.8B Technical Report (2401.16818)