Mitko Vasilev
mitkox
AI & ML interests
Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.
Recent Activity
replied to
their
post
10 days ago
Can it run DeepSeek V3 671B is the new 'can it run Doom'.
How minimalistic can I go with on device AI with behemoth models - here I'm running DeepSeek V3 MoE on a single A6000 GPU.
Not great, not terrible, for this minimalistic setup. I love the Mixture of Experts architectures. Typically I'm running my core LLM distributed over the 4 GPUs.
Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.
replied to
their
post
10 days ago
Can it run DeepSeek V3 671B is the new 'can it run Doom'.
How minimalistic can I go with on device AI with behemoth models - here I'm running DeepSeek V3 MoE on a single A6000 GPU.
Not great, not terrible, for this minimalistic setup. I love the Mixture of Experts architectures. Typically I'm running my core LLM distributed over the 4 GPUs.
Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.
Organizations
mitkox's activity
Bye Apple and hi NVIDIA
4
#6 opened about 2 months ago
by
mitkox
Upload folder using huggingface_hub
2
#1 opened 4 months ago
by
mitkox
Apply for community grant: Academic project
1
#1 opened 8 months ago
by
estyle
Transformers version for recurrent_gemma?
2
#4 opened 9 months ago
by
mitkox
How long does this approval process take?
11
#10 opened 11 months ago
by
mitkox
aya-101 GGUF 4bit
4
#9 opened 11 months ago
by
mitkox
Not able to run this model?
6
#1 opened about 1 year ago
by
mantafloppy