The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLVIII-4/W7-2023
https://doi.org/10.5194/isprs-archives-XLVIII-4-W7-2023-223-2023
https://doi.org/10.5194/isprs-archives-XLVIII-4-W7-2023-223-2023
22 Jun 2023
 | 22 Jun 2023

GEOAI FOR MARINE ECOSYSTEM MONITORING: A COMPLETE WORKFLOW TO GENERATE MAPS FROM AI MODEL PREDICTIONS

J. Talpaert Daudon, M. Contini, I. Urbina-Barreto, B. Elliott, F. Guilhaumon, A. Joly, S. Bonhommeau, and J. Barde

Keywords: GeoAI, computer vision, deep learning, marine ecology, object detection, segmentation, geospatial, photogrammetry

Abstract. Mapping and monitoring marine ecosystems imply several challenges for data collection and processing: water depth, restricted access to locations, instrumentation costs or weather constraints for sampling, among others. Nowadays, Artificial Intelligence (AI) and Geographic Information System (GIS) open source software can be combined in new kinds of workflows, to annotate and predict objects directly on georeferenced raster data (e.g. orthomosaics). Here, we describe and share the code of a generic method to train a deep learning model with spatial annotations and use it to directly generate model predictions as spatial features. This workflow has been tested and validated in three use cases related to marine ecosystem monitoring at different geographic scales: (i) segmentation of corals on orthomosaics made of underwater images to automate coral reef habitats mapping, (ii) detection and classification of fishing vessels on remote sensing satellite imagery to estimate a proxy of fishing effort (iii) segmentation of marine species and habitats on underwater images with a simple geolocation. Models have been successfully trained and the models predictions are displayed with maps in the three use cases.