Gemma Model Card

Model Page: Gemma

This model card corresponds to the 2B and 7B Instruct versions of the Gemma model's Guff.

Terms of Use: Terms

Description

Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models.

Model Usage

Since this is a guff, it can be run locally using

  • Ollama
  • Llama.cpp
  • LM Studio
  • And Many More
  • I have provided GemmaModelFile that can be used with ollama by:
  • Download the model:
    pip install huggingface_hub
    from huggingface_hub import hf_hub_download
    
    model_id="c2p-cmd/google_gemma_guff"
    hf_hub_download(repo_id=model_id, local_dir="gemma_snapshot", local_dir_use_symlinks=False, filename="gemma_snapshot/gemma-2b-it.gguf")
    
  • Load the model file to ollama
    ollama create gemma -f GemmaModelFile
    
  • You change the model name based on needs
Downloads last month
13
GGUF
Model size
2.51B params
Architecture
gemma
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.