Splend1dchan
commited on
Commit
•
bf07047
1
Parent(s):
983ba66
Update README.md
Browse files
README.md
CHANGED
@@ -78,11 +78,12 @@ Breeze-7B-32k-Base clears the tasks with 90+% accuracy, shown in the figure belo
|
|
78 |
|
79 |
## Use in Transformers
|
80 |
|
81 |
-
First install direct dependencies:
|
82 |
```
|
83 |
pip install transformers torch accelerate
|
84 |
```
|
85 |
-
|
|
|
86 |
```bash
|
87 |
pip install packaging ninja
|
88 |
pip install flash-attn
|
|
|
78 |
|
79 |
## Use in Transformers
|
80 |
|
81 |
+
First, install direct dependencies:
|
82 |
```
|
83 |
pip install transformers torch accelerate
|
84 |
```
|
85 |
+
<p style="color:red;">Flash-attention2 is strongly recommended for long context scenarios.</p>
|
86 |
+
|
87 |
```bash
|
88 |
pip install packaging ninja
|
89 |
pip install flash-attn
|