 |
G. N. Akhobdze, E. Yu. Rusyaeva, A. V. Poltavsky Entropy Information Approach for Evaluating the Quality of Machine Translation Texts |
 |
|
Abstract.
Based on the entropy-information approach, a method for assessing the quality of machine translation texts is proposed. An analysis is given of the dispersion and entropy coefficients of concordance used to assess the consistency of expert opinions with close rankings of various objects. The prospects of using the entropy coefficient of concordance, which makes it possible to fix the fact of division of opinions into two opposing groups, are substantiated. This provision is important for the study, since in this method ofexpert evaluation of text translations, it is important to take into account the different opinions of several experts involved in the examination. Examples of calculating the entropy coefficient of concordance with a changing rank system, the number of experts and ranked evaluation objects are given.
Keywords:
concrodation coefficient, text ranking, expert opinion, information entropy, rank, expert opinion matrix, probabilistic parameters.
PP. 19-27.
DOI 10.14357/20718632230402
EDN EOBUMC References
1. Poltavsky A.V., Rusyaeva E.Yu. Entropy Evaluation of Data Flows Using an Integrative Approach. In:Proceedings of the 15th International Conference Management of Large- Scale System Development MLSD 2022. 26–28 September 2022, Moscow, Russia: IEEE; 2022. P.1-4. doi: 10.1109/MLSD55143.2022.9934166 2. Introducing ChatGPT and Whisper APIs. Developers can now integrate ChatGPT and Whisper models into their apps and products through our API. Available from: https://openai.com/blog/introducing-chatgpt-and-whisperapis. [Accessed 27 April 2023] 3. Popkov Yu.S. Mathematical Demoeconomics. macrosystem approach. M.: LENAND. 2021. 560 p. (In Russ). 4. O. I. Larichev, Verbal decision analysis. M.: Nauka, 2006. 181 p. (In Russ). 5. Averkin A.N., Batyrshin I.Z., Blishun A.F. et al. Fuzzy sets in control and artificial intelligence models; Ed. D. A. Pospelova. M.: Nauka, 1986. 312 p. (In Russ). 6. Aleskerov F. T., Khabina E. L., Shvarts D. A. Binary relations, graphs and collective solutions. M.: GU VSHE, 2006. - 298 p. (In Russ). 7. Volsky V. I., Lezina Z. M. Voting in small groups: procedures and methods of comparative analysis. M.: Nauka, 1991. 192 p. (In Russ). 8. Kitaev N. N. Group expert assessments. M.: Knowledge, 1975. 64 p. (In Russ). 9. Mirkin BG The problem of group choice. M.: Nauka, 1974. 256 p. (In Russ). 10. Multi-objective Group Decision Making: Methods, Software and Applications With Fuzzy Set Techniques; J. Lu, G. Zhang, D. Ruan, F. Wu. London: Imperial College Press, 2007. 400 pp. 11. Arrow K. J. Collective choice and individual values. M.: GU VSHE, 2004. 204 p. (In Russ). 12. Lewis R. D., Raifa G. Games and solutions. M.: Foreign Literature, 1961. 642 p. (In Russ). 13. Zhilyakova E.V., Larin S.P. Methods and techniques for conducting an independent examination. Bulletin of the Voronezh State University. Series: Economics and Management. 2009; 2:108-116. (In Russ). 14. Venediktov A.A. On the indicator of consistency of expert assessments. Armament and Economics. 2018;3 (45):52-66 (In Russ). Available from: http://www.viek.ru/45/52-66.pdf. [Accessed 17 April 2023] 15. Buravlev A.I. On the tasks of multi-criteria choice. Armament and Economics. 2021;1 (55): 131-138. (In Russ). Available from: http://www.viek.ru/55/131-138.pdf. [Accessed 07 April 2023] 16. Klevets N.I. Comparative analysis of methods for multi-criteria ranking of alternatives // Scientific Bulletin: Finance, banks, investments. 2018;2:153-163 (In Russ). 17. Larichev O. I. Theory and methods of making decisions. Moscow: Logos; 2002. 296 p. (In Russ) 18. Evaluation of the consistency of expert opinions. Available from: https://studfile.net/preview/9186952/page:22/ [Accessed 05 April 2023]. (In Russ) 19. V. N. Burkov and D. A. Novikov, Elements of Graph Theory. Available from: http://www.mtas.ru/start/t_garf.pdf [Accessed 03 May 2023]. (In Russ)
|
