Using BERT and Augmentation in Named Entity Recognition for Cybersecurity Domain

The paper presents the results of applying the BERT representation model in the named entity recognition task for the cybersecurity domain in Russian. Several variants of the model were investigated. The best results were obtained using the BERT model, trained on the target collection of information...

Descripción completa

Detalles Bibliográficos
Autores principales: Tikhomirov, Mikhail, Loukachevitch, N., Sirotina, Anastasiia, Dobrov, Boris
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2020
Materias:
Article
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7298172/
http://dx.doi.org/10.1007/978-3-030-51310-8_2
Descripción
Sumario:The paper presents the results of applying the BERT representation model in the named entity recognition task for the cybersecurity domain in Russian. Several variants of the model were investigated. The best results were obtained using the BERT model, trained on the target collection of information security texts. We also explored a new form of data augmentation for the task of named entity recognition.

Ejemplares similares