README.md

metadata

license: apache-2.0
base_model: h2oai/h2o-danube2-1.8b-chat
inference: false
language:
  - en
pipeline_tag: text-generation
tags:
  - llm
  - gpt
  - large language model

h2o-danube2-1.8b-chat - GGUF

• Model creator: H2O.ai
• Original model: h2o-danube2-1.8b-chat

Description

This repo contains GGUF format model files for h2o-danube2-1.8b-chat.

Provided files

• h2o-danube2-1.8b-chat-Q2_K.gguf
• h2o-danube2-1.8b-chat-Q3_K_M.gguf
• h2o-danube2-1.8b-chat-Q4_K_M.gguf
• h2o-danube2-1.8b-chat-Q5_K_M.gguf
• h2o-danube2-1.8b-chat-Q6_K.gguf