<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "https://jats.nlm.nih.gov/nlm-dtd/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="3.0" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher">ISPRS-Archives</journal-id>
<journal-title-group>
<journal-title>The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences</journal-title>
<abbrev-journal-title abbrev-type="publisher">ISPRS-Archives</abbrev-journal-title>
<abbrev-journal-title abbrev-type="nlm-ta">Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.</abbrev-journal-title>
</journal-title-group>
<issn pub-type="epub">2194-9034</issn>
<publisher><publisher-name>Copernicus Publications</publisher-name>
<publisher-loc>Göttingen, Germany</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.5194/isprsarchives-XL-5-W6-83-2015</article-id>
<title-group>
<article-title>DACTYL ALPHABET GESTURE RECOGNITION IN A VIDEO SEQUENCE USING MICROSOFT KINECT</article-title>
</title-group>
<contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Artyukhin</surname>
<given-names>S. G.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Mestetskiy</surname>
<given-names>L. M.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
</contrib-group><aff id="aff1">
<label>1</label>
<addr-line>MSU, Faculty of Computational Mathematics and Cybernetics, GSP-1, 1-52, Leninskiye Gory, 119991, Moscow, Russia</addr-line>
</aff>
<pub-date pub-type="epub">
<day>18</day>
<month>05</month>
<year>2015</year>
</pub-date>
<volume>XL-5/W6</volume>
<fpage>83</fpage>
<lpage>86</lpage>
<permissions>
<copyright-statement>Copyright: &#x000a9; 2015 S. G. Artyukhin</copyright-statement>
<copyright-year>2015</copyright-year>
<license license-type="open-access">
<license-p>This work is licensed under the Creative Commons Attribution 3.0 Unported License. To view a copy of this licence, visit <ext-link ext-link-type="uri"  xlink:href="https://creativecommons.org/licenses/by/3.0/">https://creativecommons.org/licenses/by/3.0/</ext-link></license-p>
</license>
</permissions>
<self-uri xlink:href="https://isprs-archives.copernicus.org/articles/XL-5-W6/83/2015/isprs-archives-XL-5-W6-83-2015.html">This article is available from https://isprs-archives.copernicus.org/articles/XL-5-W6/83/2015/isprs-archives-XL-5-W6-83-2015.html</self-uri>
<self-uri xlink:href="https://isprs-archives.copernicus.org/articles/XL-5-W6/83/2015/isprs-archives-XL-5-W6-83-2015.pdf">The full text article is available as a PDF file from https://isprs-archives.copernicus.org/articles/XL-5-W6/83/2015/isprs-archives-XL-5-W6-83-2015.pdf</self-uri>
<abstract>
<p>This paper presents an efficient framework for solving the problem of static gesture recognition based on data obtained from the web
cameras and depth sensor Kinect (RGB-D - data). Each gesture given by a pair of images: color image and depth map. The database
store gestures by it features description, genereated by frame for each gesture of the alphabet. Recognition algorithm takes as input
a video sequence (a sequence of frames) for marking, put in correspondence with each frame sequence gesture from the database,
or decide that there is no suitable gesture in the database. First, classification of the frame of the video sequence is done separately
without interframe information. Then, a sequence of successful marked frames in equal gesture is grouped into a single static gesture.
We propose a method combined segmentation of frame by depth map and RGB-image. The primary segmentation is based on the depth
map. It gives information about the position and allows to get hands rough border. Then, based on the color image border is specified
and performed analysis of the shape of the hand. Method of continuous skeleton is used to generate features. We propose a method of
skeleton terminal branches, which gives the opportunity to determine the position of the fingers and wrist. Classification features for
gesture is description of the position of the fingers relative to the wrist. The experiments were carried out with the developed algorithm
on the example of the American Sign Language. American Sign Language gesture has several components, including the shape of the
hand, its orientation in space and the type of movement. The accuracy of the proposed method is evaluated on the base of collected
gestures consisting of 2700 frames.</p>
</abstract>
<counts><page-count count="4"/></counts>
</article-meta>
</front>
<body/>
<back>
</back>
</article>