Quantizations of https://huggingface.co/NousResearch/Nous-Hermes-Llama2-13b

Inference Clients/UIs


From original readme

Prompt Format

The model follows the Alpaca prompt format:

### Instruction:
<prompt>

### Response:
<leave a newline blank for model to respond>

or

### Instruction:
<prompt>

### Input:
<additional context>

### Response:
<leave a newline blank for model to respond>
Downloads last month
453
GGUF
Model size
13B params
Architecture
llama

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.