bartowski/MSM-MS-Cydrion-22B-GGUF
Text Generation
•
Updated
•
1.24k
•
6
aohenduo
chenduo
AI & ML interests
None yet
Recent Activity
liked
a model
about 1 month ago
bartowski/MSM-MS-Cydrion-22B-GGUF
new activity
about 2 months ago
shenzhi-wang/Llama3.1-70B-Chinese-Chat:Will there be multimodal support?
Organizations
None yet
chenduo's activity
liked
a
model
about 1 month ago
Will there be multimodal support?
#10 opened about 2 months ago
by
chenduo
liked
a
Space
2 months ago
reacted to
reach-vb's
post with 👍
2 months ago
Post
5441
Multimodal Ichigo Llama 3.1 - Real Time Voice AI 🔥
> WhisperSpeech X Llama 3.1 8B
> Trained on 50K hours of speech (7 languages)
> Continually trained on 45hrs 10x A1000s
> MLS -> WhisperVQ tokens -> Llama 3.1
> Instruction tuned on 1.89M samples
> 70% speech, 20% transcription, 10% text
> Apache 2.0 licensed ⚡
Architecture:
> WhisperSpeech/ VQ for Semantic Tokens
> Llama 3.1 8B Instruct for Text backbone
> Early fusion (Chameleon)
I'm super bullish on HomeBrew/ Jan and early fusion, audio and text, multimodal models!
(P.S. Play with the demo on Hugging Face: jan-hq/Ichigo-llama3.1-s-instruct)
> WhisperSpeech X Llama 3.1 8B
> Trained on 50K hours of speech (7 languages)
> Continually trained on 45hrs 10x A1000s
> MLS -> WhisperVQ tokens -> Llama 3.1
> Instruction tuned on 1.89M samples
> 70% speech, 20% transcription, 10% text
> Apache 2.0 licensed ⚡
Architecture:
> WhisperSpeech/ VQ for Semantic Tokens
> Llama 3.1 8B Instruct for Text backbone
> Early fusion (Chameleon)
I'm super bullish on HomeBrew/ Jan and early fusion, audio and text, multimodal models!
(P.S. Play with the demo on Hugging Face: jan-hq/Ichigo-llama3.1-s-instruct)
reacted to
clem's
post with 👍
5 months ago
Post
2497
This is the week of small AI language models!
- 4 replies
liked
a
model
6 months ago
liked
a
dataset
6 months ago
shape mismatch: value tensor of shape [2320] cannot be broadcast to indexing result of shape [2262]
6
#52 opened 7 months ago
by
yeargun
updated
2
models
7 months ago
updated
a
model
8 months ago
liked
2
models
8 months ago
Quantization error
2
#1 opened 8 months ago
by
chenduo
liked
a
model
8 months ago
liked
a
Space
8 months ago
liked
a
dataset
9 months ago
liked
a
model
9 months ago
liked
a
Space
9 months ago
liked
a
model
about 1 year ago
