anaprietonem
commited on
Commit
•
1438f0d
1
Parent(s):
cba8564
Update README.md
Browse files
README.md
CHANGED
@@ -78,13 +78,13 @@ pip install flash-attn --no-build-isolation
|
|
78 |
ai-models anemoi --checkpoint aifs_single_v0.2.1.ckpt --file example_20241107_12_n320.grib
|
79 |
```
|
80 |
|
81 |
-
**Note** we train AIFS using `flash_attention` (https://github.com/Dao-AILab/flash-attention).
|
82 |
There are currently some issues when trying to install flash attention with the latest PyTorch version 2.5 and CUDA 12.4 (https://github.com/Dao-AILab/flash-attention/issues/1330).
|
83 |
For that reason, we recommend you install PyTorch 2.4.
|
84 |
Additonally the use of 'Flash Attention' package also imposes certain requirements in terms of software and hardware. Those can be found under #Installation and Features in https://github.com/Dao-AILab/flash-attention
|
85 |
|
86 |
-
|
87 |
-
|
88 |
|
89 |
After running the `ai-models` command the output of the forecast should be written into `anemoi.grib`
|
90 |
Below you can find an example to read that file and load it as numpy array or xarray.
|
|
|
78 |
ai-models anemoi --checkpoint aifs_single_v0.2.1.ckpt --file example_20241107_12_n320.grib
|
79 |
```
|
80 |
|
81 |
+
🚨 **Note** we train AIFS using `flash_attention` (https://github.com/Dao-AILab/flash-attention).
|
82 |
There are currently some issues when trying to install flash attention with the latest PyTorch version 2.5 and CUDA 12.4 (https://github.com/Dao-AILab/flash-attention/issues/1330).
|
83 |
For that reason, we recommend you install PyTorch 2.4.
|
84 |
Additonally the use of 'Flash Attention' package also imposes certain requirements in terms of software and hardware. Those can be found under #Installation and Features in https://github.com/Dao-AILab/flash-attention
|
85 |
|
86 |
+
🚨 **Note** the `aifs_single_v0.2.1.ckpt` checkpoint just contains the model’s weights.
|
87 |
+
That file does not contain any information about the optimizer states, lr-scheduler states, etc.
|
88 |
|
89 |
After running the `ai-models` command the output of the forecast should be written into `anemoi.grib`
|
90 |
Below you can find an example to read that file and load it as numpy array or xarray.
|