Nexa quantized models for edge inference

Nexa AI
company
AI & ML interests
on-device multimodal models, on-device inference acceleration, open-source community building
Recent Activity
View all activity
Organization Card
Welcome to Nexa AI! We specialize in developing advanced on-device AI agents designed to operate seamlessly and efficiently without the need for constant cloud connectivity. Our technology empowers devices to make intelligent decisions locally, enhancing user privacy and device functionality.
For more information, please visit our website! https://nexa.ai/. You can join our waitlist to get the latest progress.
Collections
2
spaces
5
Running
60
Nexa Omni Demo
π§
Generate text from audio input
Running
78
Omnivlm Dpo Demo
π
Upload images and get detailed descriptions
Running
7
Dolphin
π
Answer questions using Qwen or Dolphin AI models
Runtime error
29
Open LLM Leaderboard for domains
π
Ranking for Open-sourced LLMs in different domains
Running
on
CPU Upgrade
31
Nexa AI GGUF Convertor
β‘
Request custom GGML quantized models via email
models
16

NexaAIDev/DeepSeek-R1-Distill-Llama-8B-NexaQuant
Updated
β’
3.38k
β’
74

NexaAIDev/DeepSeek-R1-Distill-Qwen-1.5B-NexaQuant
Updated
β’
4.17k
β’
71

NexaAIDev/OmniVLM-968M
Updated
β’
1.62k
β’
507

NexaAIDev/OmniAudio-2.6B
Audio-Text-to-Text
β’
Updated
β’
1k
β’
242

NexaAIDev/Qwen2-Audio-7B-GGUF
Audio-Text-to-Text
β’
Updated
β’
10.9k
β’
143

NexaAIDev/Squid
Updated
β’
52
β’
34

NexaAIDev/gemma-2-2b-it-GGUF
Text Generation
β’
Updated
β’
151
β’
6

NexaAIDev/octo-planner-gguf
Text Generation
β’
Updated
β’
177
β’
3

NexaAIDev/octo-planner-2b
Text Generation
β’
Updated
β’
163
β’
8

NexaAIDev/octopus-planning
Text Generation
β’
Updated
β’
63
β’
20
datasets
None public yet