The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLVIII-2/W5-2024
https://doi.org/10.5194/isprs-archives-XLVIII-2-W5-2024-73-2024
https://doi.org/10.5194/isprs-archives-XLVIII-2-W5-2024-73-2024
16 Dec 2024
 | 16 Dec 2024

Handwritten documents author verification based on the Siamese network

Vitaliy Kiselev, Dmitry Kropotov, and Nataliia Pronina

Keywords: Siamese Neural Networks, Author identification and verification, Manuscript, Handwritten text

Abstract. The paper presents a method for verifying the handwriting of a certain author in a corpus of handwritten documents based on a small number of examples, and proposes an algorithm for data preprocessing.
The use of Siamese neural network is proposed to compare and analyze unique characteristics of handwriting, writing style. This way of training allows to obtain powerful discriminative image features, embeddings, on the basis of which it is possible to make a qualitative classification of the author.
The proposed approach was applied to the task of verification of possible autographs of Zhukovsky among manuscripts of unknown authors. The approach was also applied to the classification task on a fully labeled IAM dataset.