Update README.md
Browse files
README.md
CHANGED
@@ -28,19 +28,16 @@ It has a flexible and modular design and supports several levels of parallelism
|
|
28 |
high resolution input data. AIFS forecast skill is assessed by comparing its forecasts to NWP analyses
|
29 |
and direct observational data.
|
30 |
|
31 |
-
- **Developed by:**
|
32 |
-
- **
|
33 |
-
- **
|
34 |
-
|
35 |
-
- **Language(s) (NLP):** {{ language | default("[More Information Needed]", true)}}
|
36 |
-
- **License:** {{ license | default("[More Information Needed]", true)}}
|
37 |
-
- **Finetuned from model [optional]:** {{ base_model | default("[More Information Needed]", true)}}
|
38 |
|
39 |
### Model Sources [optional]
|
40 |
|
41 |
<!-- Provide the basic links for the model. -->
|
42 |
|
43 |
-
- **Repository:** https://anemoi-docs.readthedocs.io/en/latest/index.html
|
44 |
- **Paper:** https://arxiv.org/pdf/2406.01465
|
45 |
|
46 |
## Uses
|
@@ -96,15 +93,21 @@ The full list of input and output fields is shown below:
|
|
96 |
| Geopotential, horizontal and vertical wind components, specific humidity, temperature | Pressure level: 50,100, 150, 200, 250,300, 400, 500, 600,700, 850, 925, 1000 | Both |
|
97 |
| Surface pressure, mean sea-level pressure, skin temperature, 2 m temperature, 2 m dewpoint temperature, 10 m horizontal wind components, total column water | Surface | Both |
|
98 |
| Total precipitation, convective precipitation | Surface | Output |
|
99 |
-
| Land-sea mask, orography, standard deviation of sub-grid orography, slope of sub-scale orography, insolation, latitude/longitude, time of day/day of year
|
100 |
|
101 |
### Training Procedure
|
102 |
|
103 |
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
104 |
|
105 |
-
|
106 |
-
|
107 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
108 |
|
109 |
|
110 |
#### Training Hyperparameters
|
|
|
28 |
high resolution input data. AIFS forecast skill is assessed by comparing its forecasts to NWP analyses
|
29 |
and direct observational data.
|
30 |
|
31 |
+
- **Developed by:** ECMWF
|
32 |
+
- **Model type:** Encoder-processor-decoder model
|
33 |
+
- **License:** CC BY-SA 4.0
|
34 |
+
|
|
|
|
|
|
|
35 |
|
36 |
### Model Sources [optional]
|
37 |
|
38 |
<!-- Provide the basic links for the model. -->
|
39 |
|
40 |
+
- **Repository:** [Anemoi](https://anemoi-docs.readthedocs.io/en/latest/index.html)
|
41 |
- **Paper:** https://arxiv.org/pdf/2406.01465
|
42 |
|
43 |
## Uses
|
|
|
93 |
| Geopotential, horizontal and vertical wind components, specific humidity, temperature | Pressure level: 50,100, 150, 200, 250,300, 400, 500, 600,700, 850, 925, 1000 | Both |
|
94 |
| Surface pressure, mean sea-level pressure, skin temperature, 2 m temperature, 2 m dewpoint temperature, 10 m horizontal wind components, total column water | Surface | Both |
|
95 |
| Total precipitation, convective precipitation | Surface | Output |
|
96 |
+
| Land-sea mask, orography, standard deviation of sub-grid orography, slope of sub-scale orography, insolation, latitude/longitude, time of day/day of year | Surface | Input |
|
97 |
|
98 |
### Training Procedure
|
99 |
|
100 |
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
101 |
|
102 |
+
- Pre-training was performed on ERA5 for the years 1979 to 2020 with a cosine learning rate (LR) schedule and a total
|
103 |
+
of 260,000 steps. The LR is increased from 0 to \\(10^{-4}\\) during the first 1000 steps, then it is annealed to a minimum
|
104 |
+
of \\(3 × 10^{-7}\\).
|
105 |
+
- The pre-training is then followed by rollout on ERA5 for the years 1979 to 2018, this time with a LR
|
106 |
+
of \\(6 × 10^{-7}\\). As in [Lam et al. [2023]](https://doi.org/10.48550/arXiv.2212.12794) we increase the
|
107 |
+
rollout every 1000 training steps up to a maximum of 72 h (12 auto-regressive steps).
|
108 |
+
- Finally, to further improve forecast performance, we fine-tune the model on operational real-time IFS NWP
|
109 |
+
analyses. This is done via another round of rollout training, this time using IFS operational analysis data
|
110 |
+
from 2019 and 2020
|
111 |
|
112 |
|
113 |
#### Training Hyperparameters
|