Text Generation
GGUF
Inference Endpoints
imatrix
File size: 706 Bytes
90cc9fa
 
 
 
bf6c34a
 
 
 
3ad815d
 
90cc9fa
 
8fbd49c
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
---
datasets:
- TFMC/imatrix-dataset-for-japanese-llm
pipeline_tag: text-generation
license: other
license_name: nvidia-open-model-license
license_link: >-
  https://developer.download.nvidia.com/licenses/nvidia-open-model-license-agreement-june-2024.pdf
base_model: nvidia/Nemotron-4-340B-Instruct

---
  [nvidia/Nemotron-4-340B-Instruct](https://huggingface.co/nvidia/Nemotron-4-340B-Instruct) から変換.
    
  [TFMC/imatrix-dataset-for-japanese-llm](https://huggingface.co/datasets/TFMC/imatrix-dataset-for-japanese-llm) を使用してimatrixデータを生成。

  詳細は[ここ](https://github.com/ggerganov/llama.cpp/issues/7966#issuecomment-2227104693)のissueを追ってください。