Abstract.

This paper addresses a method of optical font recognition via convolutional neural networks on images, acquired by small-scale digital cameras. We research applicability of such networks for detecting forgery of identity documents with fonts, specified in the standards. We provide experimental results of training networks for authenticity estimation of fonts, used in machine readable zones and numbers in Russian national passport. Results indicate that the proposed method can be used for specified fonts and for effective forgery detection if combined with other methods.

Keywords:

OCR, OFR, convolutional neural networks, training data synthesis.

PP. 183-191.

DOI: 10.14357/20790279180521

References

1. Young-bin Kwon, Jeong-hoon Kim. Recognition based Verification for the Machine Readable Travel Documents // International Workshop on Graphics Recognition (GREC 2007), Curitiba, Brazil, 2007.
2. De Koker L. Money laundering compliance – the challenges of technology // Financial Crimes: Psychological, Technological, and Ethical Issues, Springer, 2016, pp. 329-347.
3. Gerasimov A. Tsifrovoe moshennichestvo: riski i ushcherb. – URL: https://bosfera.ru/bo/cifrovoemoshennichestvo-riski-i-ushcherb
4. Equifax and EFX. The New Reality of Synthetic ID Fraud. // Atlanta, Georgia, 2015. – URL: https://www.equifax.com/assets/IFS/syntheticID-fraud_wp.pdf
5. K. Gai, M. Qiu, and X. Sun. “A survey on fintech,”Journal of Network and Computer Applications, 2017.
6. ICAO Doc 9303. 2015. Machine Readable Travel Documents. Seventh Edition. In twelve volumes. International Civil Aviation Organization.
7. Bertrand R., Terrades O.R., Gomez-Krämer P., Franco P., Ogier J.-M. A Conditional Random Field model for font forgery detection // 13th International Conference on Document Analysis and Recognition (ICDAR), pp. 576-580, 2015.
8. Bertrand R., Terrades O.R., Gomez-Krämer P., Franco P., Ogier J.-M. A system based on intrinsic features for fraudulent document detection // 12th International Conference on Document Analysis and Recognition, pp. 106-110, 2013.
9. Abramova S., Böhme R. Detecting copy-move forgeries in scanned text documents // Electronic Imaging 2016.8, 2016.
10. Zramdini A., Ingold R. Optical Font Recognition Using Typographical Features // IEEE Transactions on Pattern Analysis and Machine Intelligence. Volume 20. pp. 877-882, 1998.
11. Chen G., Yang J., Jin H., Brandt J., Shechtman, Agarwala A, Han T.X. Large-Scale Visual Font Recognition // Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
12. Bulatov K., Arlazarov V., Chernov T. et al. «SmartIDReader: Document recognition in video stream», in 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), vol. 6, IEEE, 2017, pp. 39–44. DOI: 10.1109/ICDAR.2017.347
13. Chen G., Yang J., Jin H., Brandt J., Shechtman, Agarwala A, Han T.X. Large-Scale Visual Font Recognition // Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
14. Wang Z., Yang J., Jin H., Shechtman E., Agarwala A., Brandt J., Huang T.S. DeepFont: Identify Your Font from An Image // Proc. of ACM Multimedia, 2015.
15. Berenguel A., Terrades O.R., Lladós J., Cañero C. e-Counterfeit: a mobile-server platform for document counterfeit detection // arXiv: 1708.06126, 2017.
16. Postanovlenie ot 8 iyulya 1997 g. N 828 «Ob utverzhdenii polozheniya o pasporte grazhdanina Rossijskoj Federatsii, obraztsa blanka i opisaniya pasporta grazhdanina Rossijskoj Federatsii» //Pravitel’stvo Rossijskoj Federatsii
17. Prikaz Minfina RF ot 7 fevralya 2003 g. N 14n «O realizatsii postanovleniya Pravitel’stva Rossijskoj Federatsii ot 11 noyabrya 2002 g. N 817»
18. Postanovlenie ot 29 iyulya 2016 g. N 727 «O litsenzirovanii deyatel’nosti po proizvodstvu i realizatsii zashchishchennoj ot poddelok poligraficheskoj produktsii» // Pravitel’stvo Rossijskoj Federatsii
19. Chernyshova Y., Gayer A., Sheshkus A. Generation method of synthetic training data for mobile OCR system // Proc. of 10th International Conference on Machine Vision, 2017. DOI: 10.1117/12.2310119
20. Google Fonts. – URL: https://fonts.google.com
21. Prikaz ot 13 noyabrya 2017 g. N 851 «Ob utverzhdenii administrativnogo reglamenta ministerstva vnutrennikh del Rossijskoj Federatsii po predostavleniyu gosudarstvennoj uslugi po vydache, zamene pasportov grazhdanina Rossijskoj Federatsii, udostoveryayushchikh lichnost’ grazhdanina Rossijskoj Federatsii na territorii Rossijskoj Federatsii» // Ministerstvo vnutrennikh del Rossijskoj Federatsii.
22. Postanovlenie ot 27 maya 2011 g. N 424 «O mashinochitaemoj zapisi v pasporte grazhdanina Rossijskoj Federatsii» // Pravitel’stvo Rossijskoj Federatsii