SicariusSicariiStuff
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,12 @@ language:
|
|
15 |
|
16 |
|
17 |
|
18 |
-
This is a Gemma-2 2B Finetune with surprisingly good Role-Play capabilities for its small 2B size.
|
|
|
|
|
|
|
|
|
|
|
19 |
|
20 |
|
21 |
# Model Details
|
|
|
15 |
|
16 |
|
17 |
|
18 |
+
This is a Gemma-2 2B Finetune with surprisingly good Role-Play capabilities for its small 2B size.
|
19 |
+
|
20 |
+
**Update**:
|
21 |
+
The size is not exactly 2B, more like 3B, it's a model I did some merges on a long time ago and forgot about it, then finetuned on top of it.
|
22 |
+
|
23 |
+
Also, due to an old mergekit Gemma-2 quirk, it seems that the increased size is due to the way the previous version of mergekit handles lmhead. Anyway, it turned out pretty awesome, even for a 3B size. The base is presented in FP32.
|
24 |
|
25 |
|
26 |
# Model Details
|