DevQuasar/LatitudeGames.Wayfarer-12B-GGUF
Text Generation
•
Updated
•
39
DevQuasar
community
Verified
AI & ML interests
Open-Source LLMs, Local AI Projects: https://pypi.org/project/llm-predictive-router/
Recent Activity
View all activity
DevQuasar's activity
csabakecskemeti
updated
a
model
about 4 hours ago
csabakecskemeti
updated
a
model
about 5 hours ago
csabakecskemeti
updated
a
model
about 10 hours ago
csabakecskemeti
updated
a
model
about 11 hours ago
csabakecskemeti
published
a
model
about 13 hours ago
csabakecskemeti
updated
2
models
about 17 hours ago
csabakecskemeti
published
4
models
about 17 hours ago
DevQuasar/LatitudeGames.Wayfarer-12B-GGUF
Text Generation
•
Updated
•
39
DevQuasar/lightblue.lb-reranker-0.5B-v1.0-GGUF
Text Generation
•
Updated
•
123
DevQuasar/OpenLLM-France.Lucie-7B-GGUF
Text Generation
•
Updated
•
87
DevQuasar/OpenLLM-France.Lucie-7B-Instruct-human-data-GGUF
Text Generation
•
Updated
•
92
csabakecskemeti
published
a
model
about 20 hours ago
csabakecskemeti
published
a
Space
1 day ago
csabakecskemeti
updated
a
model
1 day ago
csabakecskemeti
updated
a
model
2 days ago
csabakecskemeti
posted
an
update
14 days ago
Post
550
Managed to run the Q2 quantized Deepseek V3 base locally
The quants are uploading (probably ~10-12hrs) here: DevQuasar/deepseek-ai.DeepSeek-V3-Base-GGUF
The quants are uploading (probably ~10-12hrs) here: DevQuasar/deepseek-ai.DeepSeek-V3-Base-GGUF
-
- 1 reply
csabakecskemeti
posted
an
update
15 days ago
Post
611
Just wondering why the number of parameters changed in the model attributes/Model size from 685B to 684B after converting
deepseek-ai/DeepSeek-V3-Base from FP8 to BF16:
DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16
and not just for me:
opensourcerelease/DeepSeek-V3-Base-bf16
??
DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16
and not just for me:
opensourcerelease/DeepSeek-V3-Base-bf16
??
csabakecskemeti
posted
an
update
17 days ago
Post
1540
Happy New Year, Huggingface community!
In 2025, I'll continue my quantization (and some fine-tuning) efforts to support the open-source AI and Make knowledge free for everyone.
https://huggingface.co/DevQuasar
https://devquasar.com/
In 2025, I'll continue my quantization (and some fine-tuning) efforts to support the open-source AI and Make knowledge free for everyone.
https://huggingface.co/DevQuasar
https://devquasar.com/
- 1 reply
csabakecskemeti
posted
an
update
19 days ago
Post
2112
The
deepseek-ai/DeepSeek-V3-Base
model has featured today on CNBC tech news. The whale made a splash by using FP8 and shrink the cost of training significantly!
https://youtu.be/NJljq429cGk?si=kgk-ogPTMfJKsaA2
model has featured today on CNBC tech news. The whale made a splash by using FP8 and shrink the cost of training significantly!
https://youtu.be/NJljq429cGk?si=kgk-ogPTMfJKsaA2
- 3 replies
csabakecskemeti
posted
an
update
20 days ago
Post
1468
I've built a small utility to split safetensors file by file.
The issue/need came up when I've tried to convert the new Deepseek V3 model from FP8 to BF16.
The only Ada architecture GPU I have is an RTX 4080 and the 16GB vram was just wasn't enough for the conversion.
BTW: I'll upload the bf16 version here:
DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16
(it will take a while - days with my upload speed)
If anyone has access the resources to test it I'd appreciate a feedback if it's working or not.
The tool, is available from here:
https://github.com/csabakecskemeti/ai_utils/blob/main/safetensor_splitter.py
It's splitting every file to n pieces by the layers if possible, and create a new "model.safetensors.index.json" file.
I've tested it with Llama 3.1 8B and multiple split sizes, and validated by using inference pipeline.
use
Please note current version expects the model is already multiple file and have a "model.safetensors.index.json" layer-safetensor mapping file.
The issue/need came up when I've tried to convert the new Deepseek V3 model from FP8 to BF16.
The only Ada architecture GPU I have is an RTX 4080 and the 16GB vram was just wasn't enough for the conversion.
BTW: I'll upload the bf16 version here:
DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16
(it will take a while - days with my upload speed)
If anyone has access the resources to test it I'd appreciate a feedback if it's working or not.
The tool, is available from here:
https://github.com/csabakecskemeti/ai_utils/blob/main/safetensor_splitter.py
It's splitting every file to n pieces by the layers if possible, and create a new "model.safetensors.index.json" file.
I've tested it with Llama 3.1 8B and multiple split sizes, and validated by using inference pipeline.
use
--help for usagePlease note current version expects the model is already multiple file and have a "model.safetensors.index.json" layer-safetensor mapping file.