StopTryharding commited on
Commit
7eca0f1
1 Parent(s): 812dfc2

Update README.md

Browse files

Add links to EXL2 quants

Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -12,6 +12,8 @@ language:
12
  # WestLake-10.7B-v2: Role-Play & Text Generation Specialist Model
13
 
14
  [GGUF version available here](https://huggingface.co/froggeric/WestLake-10.7B-v2-GGUF)
 
 
15
 
16
  This is my first viable self-merge of the fantastic WestLake-7B-v2 model, obtained after more than 12 rounds of testing different
17
  merge configurations. In my [LLM Creativity Benchmark](https://huggingface.co/datasets/froggeric/creativity), it greatly improves over the original 7B model, and ranks between miqu-1-120b
 
12
  # WestLake-10.7B-v2: Role-Play & Text Generation Specialist Model
13
 
14
  [GGUF version available here](https://huggingface.co/froggeric/WestLake-10.7B-v2-GGUF)
15
+ **EXL2 versions available here:**
16
+ [3.3bpw](https://huggingface.co/StopTryharding/WestLake-10.7B-v2-exl2-3.3) / [4.0bpw](https://huggingface.co/StopTryharding/WestLake-10.7B-v2-exl2-4.0) / [5.0bpw](https://huggingface.co/StopTryharding/WestLake-10.7B-v2-exl2-5.0) / [6.0bpw](https://huggingface.co/StopTryharding/WestLake-10.7B-v2-exl2-6.0) / [8.0bpw](https://huggingface.co/StopTryharding/WestLake-10.7B-v2-exl2-8.0)
17
 
18
  This is my first viable self-merge of the fantastic WestLake-7B-v2 model, obtained after more than 12 rounds of testing different
19
  merge configurations. In my [LLM Creativity Benchmark](https://huggingface.co/datasets/froggeric/creativity), it greatly improves over the original 7B model, and ranks between miqu-1-120b