49181

Автор(ы): 

Автор(ов): 

3

Параметры публикации

Тип публикации: 

Доклад

Название: 

Automated language detection in the global monitoring systems of the information space with big data

ISBN/ISSN: 

978-1-5386-6467-4

DOI: 

10.1109/ICAICT.2018.8747043

Наименование конференции: 

  • 12th IEEE International Conference on Application of Information and Communication Technologies (AICT2018, Almaty)

Наименование источника: 

  • Proceedings of the 12th IEEE International Conference on Application of Information and Communication Technologies (AICT2018, Almaty)

Город: 

  • Almaty

Издательство: 

  • IEEE Catalog Number: CFP1856H-PRT

Год издания: 

2018

Страницы: 

24-27. https://ieeexplore.ieee.org/document/8747043
Аннотация
The paper studies some aspects of building a global information monitoring system with big data by using the method of automated language determination. The language identification technology, which significantly reduces the consumption of resources at processing incoming data in systems for analyzing large amounts of multilingual information and increases their efficiency are described. The technology is based on revealed thematically independent syntactic markers, which allow not only to highlight the grammatical basis of the text, but also to identify the language that was used to record information in it. A functional mathematical model was created that presents the essence and main components of the developed technology, and also proposed a system for assessing its effectiveness.

Библиографическая ссылка: 

Фархадов М.П., Калегин С.Н., Фархадова М.Э. Automated language detection in the global monitoring systems of the information space with big data / Proceedings of the 12th IEEE International Conference on Application of Information and Communication Technologies (AICT2018, Almaty). Almaty: IEEE Catalog Number: CFP1856H-PRT, 2018. С. 24-27. https://ieeexplore.ieee.org/document/8747043.