Graph Machine Learning
AnemoI
English
jpxkqx commited on
Commit
55d280a
1 Parent(s): 18e6b7d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -12
README.md CHANGED
@@ -28,19 +28,16 @@ It has a flexible and modular design and supports several levels of parallelism
28
  high resolution input data. AIFS forecast skill is assessed by comparing its forecasts to NWP analyses
29
  and direct observational data.
30
 
31
- - **Developed by:** {{ developers | default("[More Information Needed]", true)}}
32
- - **Funded by [optional]:** {{ funded_by | default("[More Information Needed]", true)}}
33
- - **Shared by [optional]:** {{ shared_by | default("[More Information Needed]", true)}}
34
- - **Model type:** {{ model_type | default("[More Information Needed]", true)}}
35
- - **Language(s) (NLP):** {{ language | default("[More Information Needed]", true)}}
36
- - **License:** {{ license | default("[More Information Needed]", true)}}
37
- - **Finetuned from model [optional]:** {{ base_model | default("[More Information Needed]", true)}}
38
 
39
  ### Model Sources [optional]
40
 
41
  <!-- Provide the basic links for the model. -->
42
 
43
- - **Repository:** https://anemoi-docs.readthedocs.io/en/latest/index.html
44
  - **Paper:** https://arxiv.org/pdf/2406.01465
45
 
46
  ## Uses
@@ -96,15 +93,21 @@ The full list of input and output fields is shown below:
96
  | Geopotential, horizontal and vertical wind components, specific humidity, temperature | Pressure level: 50,100, 150, 200, 250,300, 400, 500, 600,700, 850, 925, 1000 | Both |
97
  | Surface pressure, mean sea-level pressure, skin temperature, 2 m temperature, 2 m dewpoint temperature, 10 m horizontal wind components, total column water | Surface | Both |
98
  | Total precipitation, convective precipitation | Surface | Output |
99
- | Land-sea mask, orography, standard deviation of sub-grid orography, slope of sub-scale orography, insolation, latitude/longitude, time of day/day of year | Surface | Input |
100
 
101
  ### Training Procedure
102
 
103
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
104
 
105
- #### Preprocessing [optional]
106
-
107
- {{ preprocessing | default("[More Information Needed]", true)}}
 
 
 
 
 
 
108
 
109
 
110
  #### Training Hyperparameters
 
28
  high resolution input data. AIFS forecast skill is assessed by comparing its forecasts to NWP analyses
29
  and direct observational data.
30
 
31
+ - **Developed by:** ECMWF
32
+ - **Model type:** Encoder-processor-decoder model
33
+ - **License:** CC BY-SA 4.0
34
+
 
 
 
35
 
36
  ### Model Sources [optional]
37
 
38
  <!-- Provide the basic links for the model. -->
39
 
40
+ - **Repository:** [Anemoi](https://anemoi-docs.readthedocs.io/en/latest/index.html)
41
  - **Paper:** https://arxiv.org/pdf/2406.01465
42
 
43
  ## Uses
 
93
  | Geopotential, horizontal and vertical wind components, specific humidity, temperature | Pressure level: 50,100, 150, 200, 250,300, 400, 500, 600,700, 850, 925, 1000 | Both |
94
  | Surface pressure, mean sea-level pressure, skin temperature, 2 m temperature, 2 m dewpoint temperature, 10 m horizontal wind components, total column water | Surface | Both |
95
  | Total precipitation, convective precipitation | Surface | Output |
96
+ | Land-sea mask, orography, standard deviation of sub-grid orography, slope of sub-scale orography, insolation, latitude/longitude, time of day/day of year | Surface | Input |
97
 
98
  ### Training Procedure
99
 
100
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
101
 
102
+ - Pre-training was performed on ERA5 for the years 1979 to 2020 with a cosine learning rate (LR) schedule and a total
103
+ of 260,000 steps. The LR is increased from 0 to \\(10^{-4}\\) during the first 1000 steps, then it is annealed to a minimum
104
+ of \\(3 × 10^{-7}\\).
105
+ - The pre-training is then followed by rollout on ERA5 for the years 1979 to 2018, this time with a LR
106
+ of \\(6 × 10^{-7}\\). As in [Lam et al. [2023]](https://doi.org/10.48550/arXiv.2212.12794) we increase the
107
+ rollout every 1000 training steps up to a maximum of 72 h (12 auto-regressive steps).
108
+ - Finally, to further improve forecast performance, we fine-tune the model on operational real-time IFS NWP
109
+ analyses. This is done via another round of rollout training, this time using IFS operational analysis data
110
+ from 2019 and 2020
111
 
112
 
113
  #### Training Hyperparameters