|
Аннотация.
В данной статье предложен алгоритм для решения задачи извлечения информации из биомедицинских патентов и научных публикаций. Предложенный алгоритм основан на методах машинного обучения. Были проведены эксперименты на патентах из базы USPTO. Эксперименты показали, что лучшее качество извлечения показала модель, построенная на основе BioBERT.
Ключевые слова:
машинное обучение, обработка естественного языка, извлечение именованных сущностей, обработка биомедицинских текстов.
Стр. 159-166.
DOI: 10.14357/20790279230118 Литература
1. Akhondi, S., Rey, H., Schwörer, M., Maier, M., Toomey, J., Nau, H., Ilchmann, G., Sheehan, M., Irmer, M., Bobach, C., Doornenbal, M., Gregory and M., Kors, J. Automatic identification of relevant chemical compounds from patents. Database: the journal of biological databases and curation. 2019. Vol. 1. P. 1–14. 2. Jessop, D., Adams, S., Willighagen, E., Hawizy, L. and Murray-Rust, P. OSCAR4: A flexible architecture for chemical textmining. Journal of cheminformatics. 2011. Vol. 3. No. 1. P. 1–12. 3. Soysal, E., Wang, J., Jiang, M., Wu, Y., Pakhomov, S., Liu, H. and Qi, W. CLAMP – a toolkit for efficiently building customized clinical natural language processing pipelines. Journal of the American Medical Informatics Association: JAMIA. 2018. Vol. 25. No. 3. P. 331–336. 4. Swain, M. and Cole, J. 2016. ChemDataExtractor: A Toolkit for Automated Extraction of Chemical Information from the Scientific Literature. Journal of Chemical Information and Modeling. 2016. Vol. 56. No. 10. P. 1894–1904. 5. Jinhyuk, L., Wonjin, Y., Sungdong, K., Donghyeon, K., Sunkyu, K., Chan, H. S. and Jaewoo, K. BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics. 2019. Vol. 36. No. 4. P. 1234–1240. 6. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A., Kaiser, L. and Polosukhin, I. Attention Is All You Need. Advances in Neural Information Processing Systems. 2017. Vol. 30. P. 5998–6008. 7. Devlin, J., Chang, M.-W., Lee, K. and Toutanova, K. Bert: pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2019. Vol. 1. P. 4171–4186. 8. The OpenNLP Project. Available at: http://opennlp. apache.org (дата обращения 20.02.2022). 9. CRFsuite: a Fast Implementation of Conditional Random Fields (CRFs). Available at: http://www. chokkan.org/software/crfsuite/ (дата обращения 20.02.2022). 10. Barnard, J. A comparison of different approaches to Markush structure handling. Journal of Chemical Information and Computer Sciences. 1991. Vol. 31. No. 1. P. 64–68. 11. Heller, S., McNaught, A., Pletnev, I., Stein, S. and Tchekhovskoi, D. The IUPAC International Chemical Identifier. Journal of Cheminformatics. 2015. Vol. 7. P. 1–34. 12. USPTO. Available at: https://www.uspto.gov/patents (дата обращения 20.02.2022). 13. Mikolov, T., Chen, K., Corrado, G. and Dean, J. Efficient Estimation of Word Representations in Vector Space. Proceedings of Workshop at ICLR. 2013. P. 1–12. 14. Mikolov, T., Yih, W.-T. and Zweig, G. Linguistic regularities in continuous space word representations. Proceedings of NAACL-HLT. 2013. P. 746–751. 15. Cortes, C. and Vapnik, V. Support-vector networks. Machine Learning. 1995. Vol. 20. No. 3. P. 273–297. 16. Finkel, J., Grenager, T. and Manning, C. Incorporating Non-local Information into Information Extraction Systems by Gibbs Sampling. Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL 2005). 2005. P. 363–370. 17. Mitchell, T. Machine Learning. Нью-Йорк: McGraw-Hill, 1997. 432 с.
|
