Hugging Face's logo
Kooten's picture
24 2 25

Kooten

Kooten
ArchiveAI's profile picture Arex1449's profile picture ddh0's profile picture
·
https://ko-fi.com/kooten

AI & ML interests

AI lobotomy

Organizations

None yet

Kooten's activity

New activity in Kooten/Mistral-Nemo-Instruct-2407-norefuse-OAS-6.5bpw-exl2 8 months ago

Issue with model.safetensors.index.json

2
#1 opened 8 months ago by
ghostlamp
New activity in Kooten/Mistral-Nemo-Instruct-2407-norefuse-OAS 8 months ago

Getting a ValueError upon loading the model, tensors are not matching.

3
#1 opened 8 months ago by
johann15
New activity in Kooten/Kunoichi-DPO-v2-7B-6bpw-exl2 about 1 year ago

Help. Getting Gibberish Responses?

6
#1 opened about 1 year ago by deleted
New activity in Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2 about 1 year ago

Request for Higher 4bpw Quant

3
#1 opened about 1 year ago by deleted
New activity in NeverSleep/MiquMaid-v2-70B-GGUF about 1 year ago

Any plan of realeasing q2_k_s quants?

4
#1 opened about 1 year ago by
stduhpf
New activity in Kooten/MiquMaid-v1-70B-6bpw-exl2 about 1 year ago

can i request 8bpw?

1
#1 opened about 1 year ago by
Perpetuity7
New activity in Kooten/MiquMaid-v1-70B-IQ2-GGUF about 1 year ago

Thanks man!

10
#1 opened about 1 year ago by
Nexesenex

Thank you so much for doing this chore. IQ2 > EXL2 @ <3bpw ?

1
#2 opened about 1 year ago by
ProphetOfBostrom
New activity in Kooten/MiquMaid-v1-70B-3bpw-exl2 about 1 year ago

More quant?

2
#1 opened about 1 year ago by
Kotokin
New activity in Kooten/DaringMaid-20B-V1.1 about 1 year ago

Request for another exl quant

2
#1 opened about 1 year ago by
Clevyby
New activity in Kooten/DaringMaid-13B about 1 year ago

It Delivers!

2
#1 opened about 1 year ago by
LunarAura
New activity in Kooten/FlatDolphinMaid-8x7B-4bpw-exl2 about 1 year ago

using context above 4096 - need to set compress_pos_emb above 1?

5
#1 opened about 1 year ago by
Samvanity
New activity in Kooten/Euryale-1.4-L2-70B-IQ2-GGUF about 1 year ago

Kobold can run IQ2

2
#1 opened about 1 year ago by
Nexesenex
New activity in Kooten/Noromaid-7B-0.4-DPO-4bpw-exl2 about 1 year ago

This is the other model that had the same problem to my knowledge.

2
#1 opened about 1 year ago by
Nitral-AI
New activity in Kooten/Lelantos-Maid-DPO-7B-4bpw-exl2 about 1 year ago

Thanks my dude <3

3
#1 opened about 1 year ago by
Nitral-AI
New activity in Kooten/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-3.5bpw-exl2 about 1 year ago

VRAM usage & card recommendations

1
#1 opened about 1 year ago by
tensiondriven
New activity in Kooten/DaringMaid-20B about 1 year ago

Thanks! I like this one :-)

1
#1 opened about 1 year ago by
ThiloteE
New activity in Kooten/FlatOrcamaid-13b-v0.2-4bit-mlx about 1 year ago

exllama version?

2
#1 opened about 1 year ago by
Nexesenex
New activity in Kooten/DaringMaid-20B-GGUF about 1 year ago

Which version of noromaid 0.2 or 0.1 ?

1
#2 opened about 1 year ago by
anmol989
New activity in Kooten/Clover3-17B-4bpw-exl2 about 1 year ago

3bpw?

2
#1 opened about 1 year ago by
idkman2