paul-stansifer
/

qw-gemma-2e-4x1-7b-gguf

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Loss should be 1.916588.

https://wandb.ai/paul-stansifer/huggingface/runs/ew3pxvb7

Uploaded model

Developed by: paul-stansifer
License: apache-2.0
Finetuned from model : unsloth/gemma-7b-bnb-4bit

This gemma model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month: 32

GGUF

Model size

8.54B params

Architecture

gemma

2-bit

4-bit

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Model tree for paul-stansifer/qw-gemma-2e-4x1-7b-gguf

Base model

unsloth/gemma-7b-bnb-4bit

Quantized

(64)

this model