New discussion

Fp16 -> GGUF 8B script?

1
#40 opened about 1 month ago by
vdruts

Not able to download it

1
#38 opened about 2 months ago by
iffishells

Create config.json

#34 opened 3 months ago by
Jash-RA

video

#33 opened 3 months ago by
goodasdgood

run

1
#32 opened 3 months ago by
goodasdgood

FLUX GGUF conversion

1
#29 opened 4 months ago by
bsingh1324

Q8 vs Q4_1 vs FP8 on a 1070ti

#23 opened 4 months ago by
gfl1973

Changelog

#22 opened 4 months ago by
Shehab007

Which one is the best?

12
#21 opened 4 months ago by
akiokawahito

Can you add Q4K_m please ?

1
#19 opened 4 months ago by
mirek190

Can it use LoRAs?

2
#13 opened 4 months ago by
zdeto

My experience

9
#9 opened 4 months ago by
SaisExperiments

k-quants possible?

5
#2 opened 4 months ago by
CHNtentes