Robert Sinclair

ZeroWw

AI & ML interests

LLMs optimization (model quantization and back-end optimizations) so that LLMs can run on computers of people with both kidneys.

Organizations

ZeroWw's activity

New activity in aifeifei798/llama3-8B-DarkIdol-2.1-Uncensored-32K about 1 hour ago

Alternate quantizations.

15
#1 opened 3 days ago by ZeroWw
New activity in aifeifei798/llama3-8B-DarkIdol-2.2-Uncensored-1048K about 2 hours ago

Alternative quantizations.

6
#1 opened about 2 hours ago by ZeroWw
New activity in 01-ai/Yi-1.5-6B-Chat about 3 hours ago

Alternate quantizations

2
#2 opened 6 days ago by ZeroWw
New activity in 01-ai/Yi-1.5-9B-32K about 3 hours ago

Alternate quantizations

2
#1 opened 6 days ago by ZeroWw
New activity in UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3 about 3 hours ago

Alternative quantizations.

#3 opened about 3 hours ago by ZeroWw
New activity in microsoft/Phi-3-medium-128k-instruct about 5 hours ago

Please release also a LARGE model.

#14 opened about 5 hours ago by ZeroWw
New activity in wave-on-discord/gemini-nano about 5 hours ago
New activity in failspy/Phi-3-mini-4k-geminified about 17 hours ago

Alternative quantizations.

#4 opened about 17 hours ago by ZeroWw

Not uncensored.

#3 opened about 17 hours ago by ZeroWw
New activity in microsoft/Phi-3-mini-4k-instruct-gguf about 21 hours ago
New activity in Qwen/CodeQwen1.5-7B-Chat 1 day ago

Alternate quantizations.

#25 opened 1 day ago by ZeroWw
New activity in mlabonne/NeuralPipe-7B-slerp 1 day ago

Alternate quantizations.

#3 opened 1 day ago by ZeroWw
New activity in ggml-org/gguf-my-repo 2 days ago

Please support this method:

7
#96 opened 4 days ago by ZeroWw

Alternate quantizations.

1
#6 opened 2 days ago by ZeroWw
New activity in google/gemma-2-9b-it 3 days ago

not work

1
#12 opened 3 days ago by sdyy

Alternative quantizations.

#13 opened 3 days ago by ZeroWw

faster

1
#1 opened 3 days ago by aifeifei798
New activity in bartowski/Samantha-Qwen-2-7B-GGUF 3 days ago

Testing experimental quants

31
#2 opened 14 days ago by bartowski
New activity in tonyassi/voice-clone 4 days ago

The real problem of XTTSv2

#12 opened 4 days ago by ZeroWw
New activity in ZeusLabs/L3-Aethora-15B-V2 4 days ago

Alternate quantizations.

1
#2 opened 4 days ago by ZeroWw
New activity in Nitral-AI/Hathor_Stable-v0.2-L3-8B 4 days ago

Alternate quantizations.

#2 opened 4 days ago by ZeroWw
New activity in Steelskull/L3-Aethora-15B 4 days ago

Alternate quantizations.

#2 opened 4 days ago by ZeroWw
New activity in Sao10K/L3-8B-Stheno-v3.3-32K 5 days ago

An alternate quantization.

1
#4 opened 5 days ago by ZeroWw

Quantization suggestion

29
#3 opened 18 days ago by ZeroWw
New activity in deepseek-ai/DeepSeek-Coder-V2-Lite-Base 6 days ago

Alternate quantizations.

#4 opened 6 days ago by ZeroWw
New activity in CohereForAI/aya-23-8B 7 days ago

My alternate quantizations.

1
#16 opened 7 days ago by ZeroWw
New activity in zhengr/MixTAO-7Bx2-MoE-v8.1 7 days ago
New activity in Qwen/Qwen1.5-7B-Chat-GGUF 8 days ago

Please post f16 quantization.

8
#1 opened about 1 month ago by ZeroWw
New activity in mistralai/Mistral-7B-Instruct-v0.3 8 days ago

Please check these quantizations.

4
#40 opened 13 days ago by ZeroWw
New activity in BarraHome/Mistroll-7B-v2.2 11 days ago

Try my quantizations...

#3 opened 11 days ago by ZeroWw
New activity in bartowski/gemma-1.1-7b-it-GGUF 14 days ago

How did you convert it?

5
#1 opened 15 days ago by ZeroWw
New activity in cleatherbury/TextBase-7B-v0.1-Q4_K_M-GGUF 14 days ago

lots of INS....

2
#1 opened 14 days ago by ZeroWw
New activity in DeepMount00/Mistral-Ita-7b about 1 month ago

Please do v03 !

1
#3 opened about 1 month ago by ZeroWw
New activity in TheBloke/zephyr-7B-beta-GGUF about 1 month ago

wtf?

1
#11 opened about 1 month ago by ZeroWw
New activity in mlabonne/gemma-7b-it-GGUF about 1 month ago

Please upload f16 too.

#4 opened about 1 month ago by ZeroWw
New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF about 1 month ago

--leave-output-tensor !

2
#13 opened about 2 months ago by ZeroWw
New activity in CultriX/MistralTrix-v1 about 1 month ago

colab notebook.

#10 opened about 1 month ago by ZeroWw