<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="3.0" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher">ISPRS-Archives</journal-id>
<journal-title-group>
<journal-title>The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences</journal-title>
<abbrev-journal-title abbrev-type="publisher">ISPRS-Archives</abbrev-journal-title>
<abbrev-journal-title abbrev-type="nlm-ta">Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.</abbrev-journal-title>
</journal-title-group>
<issn pub-type="epub">2194-9034</issn>
<publisher><publisher-name>Copernicus Publications</publisher-name>
<publisher-loc>Göttingen, Germany</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.5194/isprs-archives-XLIII-B2-2022-553-2022</article-id>
<title-group>
<article-title>REINFORCEMENT LEARNING FOR AUTONOMOUS 3D DATA RETRIEVAL USING A MOBILE ROBOT</article-title>
</title-group>
<contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Kniaz</surname>
<given-names>V. V.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Mizginov</surname>
<given-names>V.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Bordodymov</surname>
<given-names>A.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Moshkantsev</surname>
<given-names>P.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Novikov</surname>
<given-names>D.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
</contrib-group><aff id="aff1">
<label>1</label>
<addr-line>State Res. Institute of Aviation Systems (GosNIIAS), 125319, 7, Victorenko str., Moscow, Russia</addr-line>
</aff>
<aff id="aff2">
<label>2</label>
<addr-line>Moscow Institute of Physics and Technology (MIPT), Russia</addr-line>
</aff>
<pub-date pub-type="epub">
<day>30</day>
<month>05</month>
<year>2022</year>
</pub-date>
<volume>XLIII-B2-2022</volume>
<fpage>553</fpage>
<lpage>558</lpage>
<permissions>
<copyright-statement>Copyright: © 2022 V. V. Kniaz et al.</copyright-statement>
<copyright-year>2022</copyright-year>
<license license-type="open-access">
<license-p>This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this licence, visit <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</ext-link></license-p>
</license>
</permissions>
<self-uri xlink:href="https://isprs-archives.copernicus.org/articles/isprs-archives-XLIII-B2-2022-553-2022.html">This article is available from https://isprs-archives.copernicus.org/articles/isprs-archives-XLIII-B2-2022-553-2022.html</self-uri>
<self-uri xlink:href="https://isprs-archives.copernicus.org/articles/isprs-archives-XLIII-B2-2022-553-2022.pdf">The full text article is available as a PDF file from https://isprs-archives.copernicus.org/articles/isprs-archives-XLIII-B2-2022-553-2022.pdf</self-uri>
<abstract>
<p>3D data retrieval is required in various fields such as an industrial monitoring, agriculture, and robotics. Recent advances in photogrammetry and computer vision allowed to perform 3D reconstruction using a set of images captured with uncalibrated camera. Such technique is commonly known as Structure-from-Motion. In this paper, we propose a reinforcement learning framework RL3D for online strong camera configuration planning onboard of a mobile robot. The mobile robot consists of a skid-steered wheeled platform, a single-board computer and an industrial camera. Our aim is developing a model that plans a set of robot location that provide a strong camera configuration. We developed an environment simulator to train our RL3D framework. The simulator was implemented using a 3D model of the indoor scene and includes a model of robot’s dynamics. We trained our framework using the simulator and evaluated it using a virtual and real environments. The results of the evaluation are encouraging and demonstrate that the controller model successfully learns simple camera configurations such as a circle around an object.</p>
</abstract>
<counts><page-count count="6"/></counts>
</article-meta>
</front>
<body/>
<back>
</back>
</article>
