jhnnsjkbk commited on
Commit
b7100cd
1 Parent(s): 5d59930

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -1
README.md CHANGED
@@ -40,7 +40,8 @@ Code for Finetuning is available through [github](https://github.com/NASA-IMPACT
40
  Configuration used for finetuning is available through this [config](https://github.com/NASA-IMPACT/hls-foundation-os/blob/main/fine-tuning-examples/configs/sen1floods11.py).
41
 
42
  ### Results
43
- The experiment by running the mmseg stack for 80 epochs using the above config led to the following result:
 
44
 
45
  | **Classes** | **IoU**| **Acc**|
46
  |:------------------:|:------:|:------:|
@@ -52,5 +53,20 @@ The experiment by running the mmseg stack for 80 epochs using the above config l
52
  | 97.25% | 88.68% | 94.37% |
53
 
54
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
55
  ### Inference
56
  The github repo includes an inference script that allows to run the flood mapping model for inference on Sentinel-2 images. These input have to be geotiff format, including 6 bands for a single time-step described above (Blue, Green, Red, Narrow NIR, SWIR, SWIR 2) in order. There is also a **demo** that leverages the same code **[here](https://huggingface.co/spaces/ibm-nasa-geospatial/Prithvi-100M-sen1floods11-demo)**.
 
40
  Configuration used for finetuning is available through this [config](https://github.com/NASA-IMPACT/hls-foundation-os/blob/main/fine-tuning-examples/configs/sen1floods11.py).
41
 
42
  ### Results
43
+
44
+ Finetuning the geospatial foundation model for 100 epochs leads to the following performance on out-of-sample test data:
45
 
46
  | **Classes** | **IoU**| **Acc**|
47
  |:------------------:|:------:|:------:|
 
53
  | 97.25% | 88.68% | 94.37% |
54
 
55
 
56
+ The performance of the model has been further validated on an unseen, holdout flood event in Bolivia. The results are consistent with the performance on the test set:
57
+
58
+
59
+ | **Classes** | **IoU**| **Acc**|
60
+ |:------------------:|:------:|:------:|
61
+ | No water | 95.37% | 97.39% |
62
+ | Water/Flood | 77.95% | 88.74% |
63
+
64
+ |**aAcc**|**mIoU**|**mAcc**|
65
+ |:------:|:------:|:------:|
66
+ | 96.02% | 86.66% | 93.07% |
67
+
68
+ Finetuning took ~1 hour on a NVIDIA V100.
69
+
70
+
71
  ### Inference
72
  The github repo includes an inference script that allows to run the flood mapping model for inference on Sentinel-2 images. These input have to be geotiff format, including 6 bands for a single time-step described above (Blue, Green, Red, Narrow NIR, SWIR, SWIR 2) in order. There is also a **demo** that leverages the same code **[here](https://huggingface.co/spaces/ibm-nasa-geospatial/Prithvi-100M-sen1floods11-demo)**.