GGUF
Orca
llama
llama2
Inference Endpoints
Orca-2-GGUF / README.md
kroonen's picture
Update README.md
4ef0371
metadata
license: mit
datasets:
  - open-llm-leaderboard/details_microsoft__Orca-2-7b_public
  - open-llm-leaderboard/details_microsoft__Orca-2-13b_public
tags:
  - Orca
  - gguf
  - llama
  - llama2

This is a quantized GGUF version of Orca-2 7B and 13B quantized to 4_0 and 8_0 bits.

(link to the original model : https://www.microsoft.com/en-us/research/blog/orca-2-teaching-small-language-models-how-to-reason/)