Nitral-AI commited on
Commit
8551225
1 Parent(s): c6b79a2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -24
README.md CHANGED
@@ -8,32 +8,16 @@ tags:
8
  - merge
9
 
10
  ---
11
-
12
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/FJ1KFTBfebO1cNC0ei_x0.png)
13
 
14
- The following models were included in the merge:
15
- * [Nitral-AI/Infinitely-Laydiculous-7B](https://huggingface.co/Nitral-AI/Infinitely-Laydiculous-7B)
16
- * [Nitral-AI/Stanta-Lelemon-Maid-7B](https://huggingface.co/Nitral-AI/Stanta-Lelemon-Maid-7B)
17
 
18
- ### Configuration
19
 
20
- The following YAML configuration was used to produce this model:
 
 
 
 
21
 
22
- ```yaml
23
- slices:
24
- - sources:
25
- - model: Nitral-AI/Stanta-Lelemon-Maid-7B
26
- layer_range: [0, 32]
27
- - model: Nitral-AI/Infinitely-Laydiculous-7B
28
- layer_range: [0, 32]
29
- merge_method: slerp
30
- base_model: Nitral-AI/Stanta-Lelemon-Maid-7B
31
- parameters:
32
- t:
33
- - filter: self_attn
34
- value: [0, 0.5, 0.3, 0.7, 1]
35
- - filter: mlp
36
- value: [1, 0.5, 0.7, 0.3, 0]
37
- - value: 0.5
38
- dtype: bfloat16
39
- ```
 
8
  - merge
9
 
10
  ---
 
11
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/FJ1KFTBfebO1cNC0ei_x0.png)
12
 
13
+ # Vision/multimodal capabilities:
 
 
14
 
15
+ If you want to use vision functionality:
16
 
17
+ * You must use the latest versions of [Koboldcpp](https://github.com/LostRuins/koboldcpp).
18
+
19
+ To use the multimodal capabilities of this model and use **vision** you need to load the specified **mmproj** file, this can be found inside this model repo.
20
+
21
+ * You can load the **mmproj** by using the corresponding section in the interface:
22
 
23
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/UX6Ubss2EPNAT3SKGMLe0.png)