|
--- |
|
language: |
|
- en |
|
license: llama3 |
|
tags: |
|
- Llama-3 |
|
- instruct |
|
- finetune |
|
- chatml |
|
- synthetic data |
|
- distillation |
|
- function calling |
|
- json mode |
|
- axolotl |
|
- roleplaying |
|
- chat |
|
base_model: meta-llama/Meta-Llama-3.1-8B |
|
widget: |
|
- example_title: Hermes 3 |
|
messages: |
|
- role: system |
|
content: You are a sentient, superintelligent artificial general intelligence, |
|
here to teach and assist me. |
|
- role: user |
|
content: What is the meaning of life? |
|
model-index: |
|
- name: Hermes-3-Llama-3.1-70B |
|
results: [] |
|
--- |
|
|
|
This is the 8-bit quantized version of [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B) by following [the example](https://github.com/AutoGPTQ/AutoGPTQ/blob/main/examples/quantization/basic_usage.py) from the AutoGPTQ repository. |
|
|
