macadeliccc
/

dolphin-2.9.3-Yi-1.5-34B-32k-GGUF

Generated from Trainer

Inference Endpoints

Model card Files Files and versions Community

Dolphin 2.9.3 Yi 1.5 34b 32k 🐬

Curated and trained by Eric Hartford, Lucas Atkins, and Fernando Fernandes, and Cognitive Computations

Discord: https://discord.gg/cognitivecomputations

Usage

ollama run CognitiveComputations/dolphin-yi-1.5-32k:34b-v2.9.3-q4_0

Supported Tags

dolphin-yi-1.5-32k:34b-v2.9.3-q2_k
dolphin-yi-1.5-32k:34b-v2.9.3-q3_k
dolphin-yi-1.5-32k:34b-v2.9.3-q4_0
dolphin-yi-1.5-32k:34b-v2.9.3-q4_k_m
dolphin-yi-1.5-32k:34b-v2.9.3-q4_k_s
dolphin-yi-1.5-32k:34b-v2.9.3-q5_0
dolphin-yi-1.5-32k:34b-v2.9.3-q5_k_m
dolphin-yi-1.5-32k:34b-v2.9.3-q5_k_s
dolphin-yi-1.5-32k:34b-v2.9.3-q6_k
dolphin-yi-1.5-32k:34b-v2.9.3-q8_0

Downloads last month: 88

GGUF

Model size

34.4B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for macadeliccc/dolphin-2.9.3-Yi-1.5-34B-32k-GGUF

Base model

cognitivecomputations/dolphin-2.9.3-Yi-1.5-34B-32k

Quantized

(3)

this model

Datasets used to train macadeliccc/dolphin-2.9.3-Yi-1.5-34B-32k-GGUF