Text Generation
GGUF
English
Qwen2.5-Coder-0.5B
Inference Endpoints
conversational
Hammer2.1-0.5b-GGUF / README.md
Melvin56's picture
Update README.md
abebcbb verified
|
raw
history blame
799 Bytes
metadata
license: cc-by-nc-4.0
datasets:
  - Salesforce/xlam-function-calling-60k
  - MadeAgents/xlam-irrelevance-7.5k
base_model:
  - MadeAgents/Hammer2.1-0.5b
language:
  - en
pipeline_tag: text-generation
tags:
  - Qwen2.5-Coder-0.5B

Melvin56/Hammer2.1-0.5b-GGUF

Original Model : MadeAgents/Hammer2.1-0.5b

All quants are made using the imatrix option.

Model Size (GB)
Q2_K_S 0.32
Q2_K 0.33
Q3_K_M 0.35
Q3_K_M 0.35
Q4_0 0.35
Q4_K_M 0.39
Q5_K_M 0.41
Q6_K 0.50
Q8_0 0.52
F16 0.99