YukiTomita-CC
/

Llama-3-Swallow-8B-Instruct-v0.1-IMat-GGUF_dolly-15k-ja-prompt

Inference Endpoints

Model card Files Files and versions Community

No model card

New: Create and edit this model card directly on the website!

Contribute a Model Card

Downloads last month: 191

GGUF

Model size

8.03B params

Architecture

llama

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

Inference API

Unable to determine this model's library. Check the docs .

Space using YukiTomita-CC/Llama-3-Swallow-8B-Instruct-v0.1-IMat-GGUF_dolly-15k-ja-prompt 1

Collection including YukiTomita-CC/Llama-3-Swallow-8B-Instruct-v0.1-IMat-GGUF_dolly-15k-ja-prompt

GGUF Accuracy Test

llama.cppのGGUFの量子化について精度などを検証するために作成したコレクションです。検証結果をまとめた記事は下記をご覧ください。https://zenn.dev/yuki127/articles/e3337c176d27f2 • 7 items • Updated Aug 5 • 1