Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Hathor-v3.3 - GGUF

Name Quant method Size
Hathor-v3.3.Q2_K.gguf Q2_K 2.53GB
Hathor-v3.3.IQ3_XS.gguf IQ3_XS 2.81GB
Hathor-v3.3.IQ3_S.gguf IQ3_S 2.96GB
Hathor-v3.3.Q3_K_S.gguf Q3_K_S 2.95GB
Hathor-v3.3.IQ3_M.gguf IQ3_M 3.06GB
Hathor-v3.3.Q3_K.gguf Q3_K 3.28GB
Hathor-v3.3.Q3_K_M.gguf Q3_K_M 3.28GB
Hathor-v3.3.Q3_K_L.gguf Q3_K_L 3.56GB
Hathor-v3.3.IQ4_XS.gguf IQ4_XS 3.67GB
Hathor-v3.3.Q4_0.gguf Q4_0 3.83GB
Hathor-v3.3.IQ4_NL.gguf IQ4_NL 3.87GB
Hathor-v3.3.Q4_K_S.gguf Q4_K_S 3.86GB
Hathor-v3.3.Q4_K.gguf Q4_K 4.07GB
Hathor-v3.3.Q4_K_M.gguf Q4_K_M 4.07GB
Hathor-v3.3.Q4_1.gguf Q4_1 4.24GB
Hathor-v3.3.Q5_0.gguf Q5_0 4.65GB
Hathor-v3.3.Q5_K_S.gguf Q5_K_S 4.65GB
Hathor-v3.3.Q5_K.gguf Q5_K 4.78GB
Hathor-v3.3.Q5_K_M.gguf Q5_K_M 4.78GB
Hathor-v3.3.Q5_1.gguf Q5_1 5.07GB
Hathor-v3.3.Q6_K.gguf Q6_K 5.53GB
Hathor-v3.3.Q8_0.gguf Q8_0 7.17GB

Original model description:

base_model:

  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/physics_non_masked
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/philosophy_non_masked
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/human_sexuality
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/electrical_engineering
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/college_chemistry
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/formal_logic
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/college_computer_science
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/philosophy_100
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/sociology
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/psychology
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/conceptual_physics
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/college_physics
  • MrRobotoAI/Hathor-v4.1
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/world_religions
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/philosophy
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/high_school_european_history
  • MrRobotoAI/Hathor-v3.2
  • surya-narayanan/psychology_non_masked library_name: transformers tags:
  • mergekit
  • merge

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using MrRobotoAI/Hathor-v4.1 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:

  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/philosophy
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/world_religions
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/sociology
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/human_sexuality
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/high_school_european_history
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/electrical_engineering
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/formal_logic
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/conceptual_physics
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/college_physics
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/electrical_engineering
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/college_chemistry
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/college_computer_science
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/psychology_non_masked
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/physics_non_masked
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/philosophy_non_masked
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/philosophy_100
  - model: MrRobotoAI/Hathor-v3.2+surya-narayanan/psychology

merge_method: model_stock
base_model: MrRobotoAI/Hathor-v4.1
normalize: true
dtype: float16
Downloads last month
297
GGUF
Model size
7.24B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .