Lim

liminalism
ยท

AI & ML interests

Day 1

Recent Activity

liked a model about 1 month ago
Datou1111/shou_xin
liked a model 3 months ago
jadechoghari/Ferret-UI-Gemma2b
liked a model 4 months ago
nvidia/NVLM-D-72B
View all activity

Organizations

Bukit's profile picture Nerdy Face's profile picture

liminalism's activity

upvoted an article 10 months ago
view article
Article

CodeGemma - an official Google release for code LLMs

โ€ข 100
reacted to philschmid's post with ๐Ÿ‘ 10 months ago
view post
Post
7210
New state-of-the-art open LLM! ๐Ÿš€ Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. ๐Ÿคฏ

TL;DR
๐Ÿงฎ 132B MoE with 16 experts with 4 active in generation
๐ŸชŸ 32 000 context window
๐Ÿ“ˆ Outperforms open LLMs on common benchmarks, including MMLU
๐Ÿš€ Up to 2x faster inference than Llama 2 70B
๐Ÿ’ป Trained on 12T tokens
๐Ÿ”ก Uses the GPT-4 tokenizer
๐Ÿ“œ Custom License, commercially useable

Collection: databricks/dbrx-6601c0852a0cdd3c59f71962
Demo: https://huggingface.co/spaces/databricks/dbrx-instruct

Kudos to the Team at Databricks and MosaicML for this strong release in the open community! ๐Ÿค—
ยท