The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLIII-B1-2021
https://doi.org/10.5194/isprs-archives-XLIII-B1-2021-189-2021
https://doi.org/10.5194/isprs-archives-XLIII-B1-2021-189-2021
28 Jun 2021
 | 28 Jun 2021

OBJECT TRACKING CONTROL USING A GIMBAL MECHANISM

D. J. Regner, J. D. Salazar, P. V. Buschinelli, M. Machado, D. Oliveira, J. M. Santos, C. A. Marinho, and T. C. Pinto

Keywords: ROS, Gazebo, Simulation, Drone, Gimbal, Inspection, Deep learning, Photogrammetry

Abstract. This work describes a control solution for real time object tracking in images acquired for a RPAS on an object inspection environment. This, controlling a 3-axis gimbal mechanism to control a camera orientation embedded to a RPAS, using its image processed for feedback. The objective of control is to maintain the target of interest at the center of the image plane. The proposed solution uses a YOLOv3 object detection model in order to detect the target object and determine, thru rotation matrices, the new desired angles to converge the object’s position to the center of the image. To compare results of the proposed control, a linear control was tuned using a linear PI algorithm. Simulation and practice experiments successfully tracked the desired object in real time using YOLOv3 in both control approaches presented.