---
license: apache-2.0

Description: |
  This is forked from IBM's [`granite-20b-code-base-GGUF`](https://huggingface.co/ibm-granite/granite-20b-code-base-GGUF) - commit [`d70433a71e2fb9e20f8bfca3ff2d8c15393f0e44`](https://huggingface.co/ibm-granite/granite-20b-code-base-GGUF/commit/d70433a71e2fb9e20f8bfca3ff2d8c15393f0e44).
  Refer to the [original model card](https://huggingface.co/ibm-granite/granite-20b-code-base) for more details.

Usage: |
  ## Use with llama.cpp
  ```shell
  git clone https://github.com/ggerganov/llama.cpp
  cd llama.cpp

  # install
  make

  # run generation
  ./main -m granite-20b-code-base-GGUF/granite-20b-code-base.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --color
---