Chayaaaaa's picture
Upload folder using huggingface_hub
af4d5c5 verified
metadata
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - Rakuten/RakutenAI-7B-chat
  - Rakuten/RakutenAI-7B

without_chat_RakutenAI-7B_task_arithmetic

without_chat_RakutenAI-7B_task_arithmetic is a merge of the following models using mergekit:

🧩 Configuration

models:
  - model: Rakuten/RakutenAI-7B-chat
    parameters:
      weight: 0.5
  - model: Rakuten/RakutenAI-7B
    parameters:
      weight: 0.5

merge_method: task_arithmetic
base_model: Rakuten/RakutenAI-7B
parameters:
  normalize: true
  int8_mask: true

dtype: bfloat16