limcheekin's picture
feat: updated code and doc to serve the orca_mini_v3_7B-GGUF (Q4_K_M) model
4c9ba1e
metadata
title: orca_mini_v3_7B-GGUF (Q4_K_M)
colorFrom: purple
colorTo: blue
sdk: docker
models:
  - psmathur/orca_mini_v3_7b
  - TheBloke/orca_mini_v3_7B-GGUF
tags:
  - inference api
  - openai-api compatible
  - llama-cpp-python
  - orca_mini_v3_7B
  - gguf
pinned: false

orca_mini_v3_7B-GGUF (Q4_K_M)

Please refer to the index.html for more information.