Update README.md
Browse files
README.md
CHANGED
@@ -63,7 +63,7 @@ Features of this architecture:
|
|
63 |
|
64 |
### Step 1: Environment Setup
|
65 |
|
66 |
-
Since Hymba-1.5B-
|
67 |
|
68 |
- **[Local install]** Install the related packages using our provided `setup.sh` (support CUDA 12.1/12.4):
|
69 |
|
|
|
63 |
|
64 |
### Step 1: Environment Setup
|
65 |
|
66 |
+
Since Hymba-1.5B-Base employs [FlexAttention](https://pytorch.org/blog/flexattention/), which relies on Pytorch2.5 and other related dependencies, we provide two ways to setup the environment:
|
67 |
|
68 |
- **[Local install]** Install the related packages using our provided `setup.sh` (support CUDA 12.1/12.4):
|
69 |
|