File size: 860 Bytes
5b937f1 f45d1e6 5b937f1 f45d1e6 5b937f1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 |
---
license: llama3.1
model_name: Llama-3.1-Nemotron-70B-Instruct-HF
base_model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
inference: false
pipeline_tag: text-generation
library_name: transformers
model_creator: nvidia
quantized_by: Second State Inc.
tags:
- nvidia
- llama3.1
---
# Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
## Original Model
[nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF)
## Run with Gaianet
**Prompt template:**
prompt template: `llama-3-chat`
**Context size:**
chat_ctx_size: `128000`
**Run with GaiaNet:**
- Quick start: https://docs.gaianet.ai/node-guide/quick-start
- Customize your node: https://docs.gaianet.ai/node-guide/customize
*Quantized with llama.cpp b3932*
|