Olethros-8B / README.md
lodrick-the-lafted's picture
Update README.md
9db251f verified
metadata
license: llama3
datasets:
  - lodrick-the-lafted/OpusStories
  - lodrick-the-lafted/Sao10K_Claude-3-Opus-Instruct-3.3K
  - lodrick-the-lafted/Samantha-Opus
  - lodrick-the-lafted/Worldsim-Opus

Olethros-8B

L3-8b-Instruct tuned on roughly 6000 Opus generations in the hopes of adding a bit of sovl.





Quants

GGUF, Exl2 and AWQ available right now.

Type Misc Author
GGUF Static GGUF Quants mradermacher
AWQ lodrick
exl2 2.25bpw blockblockblock
exl2 2.5bpw blockblockblock
exl2 3.0bpw blockblockblock
exl2 3.5bpw blockblockblock
exl2 3.7bpw blockblockblock
exl2 4.0bpw blockblockblock
exl2 4.2bpw blockblockblock
exl2 4.4bpw blockblockblock
exl2 4.6bpw blockblockblock
exl2 4.8bpw blockblockblock
exl2 5.0bpw blockblockblock
exl2 5.5bpw blockblockblock
exl2 6.0bpw blockblockblock