YukiTomita-CC
/

Llama-3-Swallow-8B-Instruct-v0.1-IMat-GGUF_dolly-15k-ja

Inference Endpoints

Model card Files Files and versions Community

No model card

Downloads last month: 135

GGUF

Model size

8.03B params

Architecture

llama

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Collection including YukiTomita-CC/Llama-3-Swallow-8B-Instruct-v0.1-IMat-GGUF_dolly-15k-ja

GGUF Accuracy Test

llama.cppのGGUFの量子化について精度などを検証するために作成したコレクションです。検証結果をまとめた記事は下記をご覧ください。https://zenn.dev/yuki127/articles/e3337c176d27f2 • 7 items • Updated Aug 5, 2024 • 1