The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLIII-B4-2022
https://doi.org/10.5194/isprs-archives-XLIII-B4-2022-545-2022
https://doi.org/10.5194/isprs-archives-XLIII-B4-2022-545-2022
02 Jun 2022
 | 02 Jun 2022

A METHOD FOR REGIONAL ANALYSIS USING DEEP LEARNING BASED ON BIG DATA OF OMNIDIRECTIONAL IMAGES OF STREETS

T. Oki and Y. Ogawa

Keywords: Omnidirectional image, Deep learning, Big data, Semantic segmentation, Clustering, Computer vision

Abstract. In this paper, we propose a method for regional analysis using image recognition technology based on deep learning and big data of street images captured by omnidirectional cameras on vehicles. Specifically, we first construct a classification method of regions based on street images using a pretrained deep learning model (VGG16) for image recognition as a feature extractor. Next, we develop a method to evaluate the landscape and safety of streets based on the ratio of street components (such as buildings, roads, fences, vegetations, sky, street lights) at each shooting point, which is calculated by semantic segmentation.