Google releases Gemma 2 2B, ShieldGemma and Gemma Scope
β’
59
Joshua
Xenova
AI & ML interests
None yet
Recent Activity
new activity
4 days ago
onnx-community/paligemma2-3b-pt-224:PaliGemma 2 ONNX doesn't support object detection?
updated
a model
4 days ago
onnx-community/dinov2-with-registers-small-with-attentions
Articles
Organizations
Xenova's activity
posted
an
update
12 days ago
Post
2314
Introducing Moonshine Web: real-time speech recognition running 100% locally in your browser!
π Faster and more accurate than Whisper
π Privacy-focused (no data leaves your device)
β‘οΈ WebGPU accelerated (w/ WASM fallback)
π₯ Powered by ONNX Runtime Web and Transformers.js
Demo: webml-community/moonshine-web
Source code: https://github.com/huggingface/transformers.js-examples/tree/main/moonshine-web
π Faster and more accurate than Whisper
π Privacy-focused (no data leaves your device)
β‘οΈ WebGPU accelerated (w/ WASM fallback)
π₯ Powered by ONNX Runtime Web and Transformers.js
Demo: webml-community/moonshine-web
Source code: https://github.com/huggingface/transformers.js-examples/tree/main/moonshine-web
- 1 reply
reacted to
fdaudens's
post with π
21 days ago
Post
1162
π Your AI toolkit just got a major upgrade! I updated the Journalists on Hugging Face community's collection with tools for investigative work, content creation, and data analysis.
Sharing these new additions with the links in case itβs helpful:
- @wendys-llc 's excellent 6-part video series on AI for investigative journalism https://www.youtube.com/playlist?list=PLewNEVDy7gq1_GPUaL0OQ31QsiHP5ncAQ
- @jeremycaplan 's curated AI Spaces on HF https://wondertools.substack.com/p/huggingface
- @Xenova 's Whisper Timestamped (with diarization!) for private, on-device transcription Xenova/whisper-speaker-diarization & Xenova/whisper-word-level-timestamps
- Flux models for image gen & LoRAs autotrain-projects/train-flux-lora-ease
- FineGrain's object cutter finegrain/finegrain-object-cutter and object eraser (this one's cool) finegrain/finegrain-object-eraser
- FineVideo: massive open-source annotated dataset + explorer HuggingFaceFV/FineVideo-Explorer
- Qwen2 chat demos, including 2.5 & multimodal versions (crushing it on handwriting recognition) Qwen/Qwen2.5 & Qwen/Qwen2-VL
- GOT-OCR integration stepfun-ai/GOT_official_online_demo
- HTML to Markdown converter maxiw/HTML-to-Markdown
- Text-to-SQL query tool by @davidberenstein1957 for HF datasets davidberenstein1957/text-to-sql-hub-datasets
There's a lot of potential here for journalism and beyond. Give these a try and let me know what you build!
You can also add your favorite ones if you're part of the community!
Check it out: https://huggingface.co/JournalistsonHF
#AIforJournalism #HuggingFace #OpenSourceAI
Sharing these new additions with the links in case itβs helpful:
- @wendys-llc 's excellent 6-part video series on AI for investigative journalism https://www.youtube.com/playlist?list=PLewNEVDy7gq1_GPUaL0OQ31QsiHP5ncAQ
- @jeremycaplan 's curated AI Spaces on HF https://wondertools.substack.com/p/huggingface
- @Xenova 's Whisper Timestamped (with diarization!) for private, on-device transcription Xenova/whisper-speaker-diarization & Xenova/whisper-word-level-timestamps
- Flux models for image gen & LoRAs autotrain-projects/train-flux-lora-ease
- FineGrain's object cutter finegrain/finegrain-object-cutter and object eraser (this one's cool) finegrain/finegrain-object-eraser
- FineVideo: massive open-source annotated dataset + explorer HuggingFaceFV/FineVideo-Explorer
- Qwen2 chat demos, including 2.5 & multimodal versions (crushing it on handwriting recognition) Qwen/Qwen2.5 & Qwen/Qwen2-VL
- GOT-OCR integration stepfun-ai/GOT_official_online_demo
- HTML to Markdown converter maxiw/HTML-to-Markdown
- Text-to-SQL query tool by @davidberenstein1957 for HF datasets davidberenstein1957/text-to-sql-hub-datasets
There's a lot of potential here for journalism and beyond. Give these a try and let me know what you build!
You can also add your favorite ones if you're part of the community!
Check it out: https://huggingface.co/JournalistsonHF
#AIforJournalism #HuggingFace #OpenSourceAI
posted
an
update
22 days ago
Post
2823
Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! π₯ High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js. π€ Try it out yourself!
Demo: webml-community/text-to-speech-webgpu
Source code: https://github.com/huggingface/transformers.js-examples/tree/main/text-to-speech-webgpu
Model: onnx-community/OuteTTS-0.2-500M (ONNX), OuteAI/OuteTTS-0.2-500M (PyTorch)
Demo: webml-community/text-to-speech-webgpu
Source code: https://github.com/huggingface/transformers.js-examples/tree/main/text-to-speech-webgpu
Model: onnx-community/OuteTTS-0.2-500M (ONNX), OuteAI/OuteTTS-0.2-500M (PyTorch)
posted
an
update
about 1 month ago
Post
3938
We just released Transformers.js v3.1 and you're not going to believe what's now possible in the browser w/ WebGPU! π€― Let's take a look:
π Janus from Deepseek for unified multimodal understanding and generation (Text-to-Image and Image-Text-to-Text)
ποΈ Qwen2-VL from Qwen for dynamic-resolution image understanding
π’ JinaCLIP from Jina AI for general-purpose multilingual multimodal embeddings
π LLaVA-OneVision from ByteDance for Image-Text-to-Text generation
π€ΈββοΈ ViTPose for pose estimation
π MGP-STR for optical character recognition (OCR)
π PatchTST & PatchTSMixer for time series forecasting
That's right, everything running 100% locally in your browser (no data sent to a server)! π₯ Huge for privacy!
Check out the release notes for more information. π
https://github.com/huggingface/transformers.js/releases/tag/3.1.0
Demo link (+ source code): webml-community/Janus-1.3B-WebGPU
π Janus from Deepseek for unified multimodal understanding and generation (Text-to-Image and Image-Text-to-Text)
ποΈ Qwen2-VL from Qwen for dynamic-resolution image understanding
π’ JinaCLIP from Jina AI for general-purpose multilingual multimodal embeddings
π LLaVA-OneVision from ByteDance for Image-Text-to-Text generation
π€ΈββοΈ ViTPose for pose estimation
π MGP-STR for optical character recognition (OCR)
π PatchTST & PatchTSMixer for time series forecasting
That's right, everything running 100% locally in your browser (no data sent to a server)! π₯ Huge for privacy!
Check out the release notes for more information. π
https://github.com/huggingface/transformers.js/releases/tag/3.1.0
Demo link (+ source code): webml-community/Janus-1.3B-WebGPU
posted
an
update
about 1 month ago
Post
5543
Have you tried out π€ Transformers.js v3? Here are the new features:
β‘ WebGPU support (up to 100x faster than WASM)
π’ New quantization formats (dtypes)
π 120 supported architectures in total
π 25 new example projects and templates
π€ Over 1200 pre-converted models
π Node.js (ESM + CJS), Deno, and Bun compatibility
π‘ A new home on GitHub and NPM
Get started with
Learn more in our blog post: https://huggingface.co/blog/transformersjs-v3
β‘ WebGPU support (up to 100x faster than WASM)
π’ New quantization formats (dtypes)
π 120 supported architectures in total
π 25 new example projects and templates
π€ Over 1200 pre-converted models
π Node.js (ESM + CJS), Deno, and Bun compatibility
π‘ A new home on GitHub and NPM
Get started with
npm i @huggingface/transformers.Learn more in our blog post: https://huggingface.co/blog/transformersjs-v3
- 3 replies
reacted to
do-me's
post with ππ
4 months ago
Post
3324
SemanticFinder now supports WebGPU thanks to
@Xenova
's efforts with transformers.js v3!
Expect massive performance gains. Inferenced a whole book with 46k chunks in <5min. If your device doesn't support #WebGPU use the classic Wasm-based version:
- WebGPU: https://do-me.github.io/SemanticFinder/webgpu/
- Wasm: https://do-me.github.io/SemanticFinder/
WebGPU harnesses the full power of your hardware, no longer being restricted to just the CPU. The speedup is significant (4-60x) for all kinds of devices: consumer-grade laptops, heavy Nvidia GPU setups or Apple Silicon. Measure the difference for your device here: Xenova/webgpu-embedding-benchmark
Chrome currently works out of the box, Firefox requires some tweaking.
WebGPU + transformers.js allows to build amazing applications and make them accessible to everyone. E.g. SemanticFinder could become a simple GUI for populating your (vector) DB of choice. See the pre-indexed community texts here: do-me/SemanticFinder
Happy to hear your ideas!
Expect massive performance gains. Inferenced a whole book with 46k chunks in <5min. If your device doesn't support #WebGPU use the classic Wasm-based version:
- WebGPU: https://do-me.github.io/SemanticFinder/webgpu/
- Wasm: https://do-me.github.io/SemanticFinder/
WebGPU harnesses the full power of your hardware, no longer being restricted to just the CPU. The speedup is significant (4-60x) for all kinds of devices: consumer-grade laptops, heavy Nvidia GPU setups or Apple Silicon. Measure the difference for your device here: Xenova/webgpu-embedding-benchmark
Chrome currently works out of the box, Firefox requires some tweaking.
WebGPU + transformers.js allows to build amazing applications and make them accessible to everyone. E.g. SemanticFinder could become a simple GUI for populating your (vector) DB of choice. See the pre-indexed community texts here: do-me/SemanticFinder
Happy to hear your ideas!
- 1 reply
We have Transformers.js, the JavaScript/WASM/WebGPU port of the python library, which supports ~100 different architectures.
Docs: https://huggingface.co/docs/transformers.js
Repo: http://github.com/xenova/transformers.js
Is that the kind of thing you're looking for? :)
posted
an
update
4 months ago
Post
13919
I can't believe this... Phi-3.5-mini (3.8B) running in-browser at ~90 tokens/second on WebGPU w/ Transformers.js and ONNX Runtime Web! π€― Since everything runs 100% locally, no messages are sent to a server β a huge win for privacy!
- π€ Demo: webml-community/phi-3.5-webgpu
- π§βπ» Source code: https://github.com/huggingface/transformers.js-examples/tree/main/phi-3.5-webgpu
- π€ Demo: webml-community/phi-3.5-webgpu
- π§βπ» Source code: https://github.com/huggingface/transformers.js-examples/tree/main/phi-3.5-webgpu
- 11 replies
posted
an
update
5 months ago
Post
14948
I'm excited to announce that Transformers.js V3 is finally available on NPM! π₯ State-of-the-art Machine Learning for the web, now with WebGPU support! π€―β‘οΈ
Install it from NPM with:
πππ π @πππππππππππ/ππππππππππππ
or via CDN, for example: https://v2.scrimba.com/s0lmm0qh1q
Segment Anything demo: webml-community/segment-anything-webgpu
Install it from NPM with:
πππ π @πππππππππππ/ππππππππππππ
or via CDN, for example: https://v2.scrimba.com/s0lmm0qh1q
Segment Anything demo: webml-community/segment-anything-webgpu
- 5 replies
posted
an
update
5 months ago
Post
7965
Introducing Whisper Diarization: Multilingual speech recognition with word-level timestamps and speaker segmentation, running 100% locally in your browser thanks to π€ Transformers.js!
Tested on this iconic Letterman interview w/ Grace Hopper from 1983!
- Demo: Xenova/whisper-speaker-diarization
- Source code: Xenova/whisper-speaker-diarization
Tested on this iconic Letterman interview w/ Grace Hopper from 1983!
- Demo: Xenova/whisper-speaker-diarization
- Source code: Xenova/whisper-speaker-diarization
- 1 reply
posted
an
update
6 months ago
Post
6784
Introducing Whisper Timestamped: Multilingual speech recognition with word-level timestamps, running 100% locally in your browser thanks to π€ Transformers.js! Check it out!
π Xenova/whisper-word-level-timestamps π
This unlocks a world of possibilities for in-browser video editing! π€― What will you build? π
Source code: https://github.com/xenova/transformers.js/tree/v3/examples/whisper-word-timestamps
π Xenova/whisper-word-level-timestamps π
This unlocks a world of possibilities for in-browser video editing! π€― What will you build? π
Source code: https://github.com/xenova/transformers.js/tree/v3/examples/whisper-word-timestamps
- 1 reply
replied to
their
post
6 months ago
Note: Since the API is experimental, you will need to install Chrome Dev/Canary version 127 or higher, and enable a few flags to get it working (see blog post for more detailed instructions)
posted
an
update
6 months ago
Post
6122
Chrome's new
We've also added experimental support to π€ Transformers.js!
- Demo: Xenova/experimental-built-in-ai-chat
- Blog post: https://huggingface.co/blog/Xenova/run-gemini-nano-in-your-browser
windowβ.ai feature is going to change the web forever! π€― It allows you to run Gemini Nano, a powerful 3.25B parameter LLM, 100% locally in your browser!We've also added experimental support to π€ Transformers.js!
- Demo: Xenova/experimental-built-in-ai-chat
- Blog post: https://huggingface.co/blog/Xenova/run-gemini-nano-in-your-browser
-
-
- 5 replies
posted
an
update
6 months ago
Post
6014
Florence-2, the new vision foundation model by Microsoft, can now run 100% locally in your browser on WebGPU, thanks to Transformers.js! π€π€―
It supports tasks like image captioning, optical character recognition, object detection, and many more! π WOW!
- Demo: Xenova/florence2-webgpu
- Models: https://huggingface.co/models?library=transformers.js&other=florence2
- Source code: https://github.com/xenova/transformers.js/tree/v3/examples/florence2-webgpu
It supports tasks like image captioning, optical character recognition, object detection, and many more! π WOW!
- Demo: Xenova/florence2-webgpu
- Models: https://huggingface.co/models?library=transformers.js&other=florence2
- Source code: https://github.com/xenova/transformers.js/tree/v3/examples/florence2-webgpu
reacted to
dvilasuero's
post with ππ₯
7 months ago
Post
8082
Today is a huge day in Argillaβs history. We couldnβt be more excited to share this with the community: weβre joining Hugging Face!
Weβre embracing a larger mission, becoming part of a brilliant and kind team and a shared vision about the future of AI.
Over the past year, weβve been collaborating with Hugging Face on countless projects: launching partner of Docker Spaces, empowering the community to clean Alpaca translations into Spanish and other languages, launching argilla/notus-7b-v1 building on Zephyrβs learnings, the Data is Better Together initiative with hundreds of community contributors, or releasing argilla/OpenHermesPreferences, one of the largest open preference tuning datasets
After more than 2,000 Slack messages and over 60 people collaborating for over a year, it already felt like we were part of the same team, pushing in the same direction. After a week of the smoothest transition you can imagine, weβre now the same team.
To those of you whoβve been following us, this wonβt be a huge surprise, but it will be a big deal in the coming months. This acquisition means weβll double down on empowering the community to build and collaborate on high quality datasets, weβll bring full support for multimodal datasets, and weβll be in a better place to collaborate with the Open Source AI community. For enterprises, this means that the Enterprise Hub will unlock highly requested features like single sign-on and integration with Inference Endpoints.
As a founder, I am proud of the Argilla team. We're now part of something bigger and a larger team but with the same values, culture, and goals. Grateful to have shared this journey with my beloved co-founders Paco and AmΓ©lie.
Finally, huge thanks to the Chief Llama Officer @osanseviero for sparking this and being such a great partner during the acquisition process.
Would love to answer any questions you have so feel free to add them below!
Weβre embracing a larger mission, becoming part of a brilliant and kind team and a shared vision about the future of AI.
Over the past year, weβve been collaborating with Hugging Face on countless projects: launching partner of Docker Spaces, empowering the community to clean Alpaca translations into Spanish and other languages, launching argilla/notus-7b-v1 building on Zephyrβs learnings, the Data is Better Together initiative with hundreds of community contributors, or releasing argilla/OpenHermesPreferences, one of the largest open preference tuning datasets
After more than 2,000 Slack messages and over 60 people collaborating for over a year, it already felt like we were part of the same team, pushing in the same direction. After a week of the smoothest transition you can imagine, weβre now the same team.
To those of you whoβve been following us, this wonβt be a huge surprise, but it will be a big deal in the coming months. This acquisition means weβll double down on empowering the community to build and collaborate on high quality datasets, weβll bring full support for multimodal datasets, and weβll be in a better place to collaborate with the Open Source AI community. For enterprises, this means that the Enterprise Hub will unlock highly requested features like single sign-on and integration with Inference Endpoints.
As a founder, I am proud of the Argilla team. We're now part of something bigger and a larger team but with the same values, culture, and goals. Grateful to have shared this journey with my beloved co-founders Paco and AmΓ©lie.
Finally, huge thanks to the Chief Llama Officer @osanseviero for sparking this and being such a great partner during the acquisition process.
Would love to answer any questions you have so feel free to add them below!
-
- 28 replies
posted
an
update
7 months ago
Post
10242
Introducing Whisper WebGPU: Blazingly-fast ML-powered speech recognition directly in your browser! π It supports multilingual transcription and translation across 100 languages! π€―
The model runs locally, meaning no data leaves your device! π
Check it out! π
- Demo: Xenova/whisper-webgpu
- Source code: https://github.com/xenova/whisper-web/tree/experimental-webgpu
The model runs locally, meaning no data leaves your device! π
Check it out! π
- Demo: Xenova/whisper-webgpu
- Source code: https://github.com/xenova/whisper-web/tree/experimental-webgpu
- 7 replies
replied to
their
post
8 months ago
The model might be a bit large, but it could be something to try!
posted
an
update
8 months ago
Post
11483
Introducing Phi-3 WebGPU, a private and powerful AI chatbot that runs 100% locally in your browser, powered by π€ Transformers.js and onnxruntime-web!
π On-device inference: no data sent to a server
β‘οΈ WebGPU-accelerated (> 20 t/s)
π₯ Model downloaded once and cached
Try it out: Xenova/experimental-phi3-webgpu
π On-device inference: no data sent to a server
β‘οΈ WebGPU-accelerated (> 20 t/s)
π₯ Model downloaded once and cached
Try it out: Xenova/experimental-phi3-webgpu
-
- 5 replies