Cargando…

Fine-Tuning Bidirectional Encoder Representations From Transformers (BERT)–Based Models on Large-Scale Electronic Health Record Notes: An Empirical Study

BACKGROUND: The bidirectional encoder representations from transformers (BERT) model has achieved great success in many natural language processing (NLP) tasks, such as named entity recognition and question answering. However, little prior work has explored this model to be used for an important tas...

Descripción completa

Detalles Bibliográficos
Autores principales:	Li, Fei, Jin, Yonghao, Liu, Weisong, Rawat, Bhanu Pratap Singh, Cai, Pengshan, Yu, Hong
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	JMIR Publications 2019
Materias:	Original Paper
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6746103/ https://www.ncbi.nlm.nih.gov/pubmed/31516126 http://dx.doi.org/10.2196/14830

Ejemplares similares

Transfer Learning for Sentiment Classification Using Bidirectional Encoder Representations from Transformers (BERT) Model
por: Areshey, Ali, et al.
Publicado: (2023)

BERT-Kgly: A Bidirectional Encoder Representations From Transformers (BERT)-Based Model for Predicting Lysine Glycation Site for Homo sapiens
por: Liu, Yinbo, et al.
Publicado: (2022)

Do syntactic trees enhance Bidirectional Encoder Representations from Transformers (BERT) models for chemical–drug relation extraction?
por: Tang, Anfu, et al.
Publicado: (2022)

Adapting Bidirectional Encoder Representations from Transformers (BERT) to Assess Clinical Semantic Textual Similarity: Algorithm Development and Validation Study
por: Kades, Klaus, et al.
Publicado: (2021)

A Fine-Tuned Bidirectional Encoder Representations From Transformers Model for Food Named-Entity Recognition: Algorithm Development and Validation
por: Stojanov, Riste, et al.
Publicado: (2021)

Unified Medical Language System resources improve sieve-based generation and Bidirectional Encoder Representations from Transformers (BERT)–based ranking for concept normalization
por: Xu, Dongfang, et al.
Publicado: (2020)

Automatic text classification of actionable radiology reports of tinnitus patients using bidirectional encoder representations from transformer (BERT) and in-domain pre-training (IDPT)
por: Li, Jia, et al.
Publicado: (2022)

Fine-tuning of BERT Model to Accurately Predict Drug–Target Interactions
por: Kang, Hyeunseok, et al.
Publicado: (2022)

A Fine-Tuned BERT-Based Transfer Learning Approach for Text Classification
por: Qasim, Rukhma, et al.
Publicado: (2022)

Fine-Tuning BERT Models to Classify Misinformation on Garlic and COVID-19 on Twitter
por: Kim, Myeong Gyu, et al.
Publicado: (2022)

Transfer Learning for Sentiment Analysis Using BERT Based Supervised Fine-Tuning
por: Prottasha, Nusrat Jahan, et al.
Publicado: (2022)

Pharmacovigilance with Transformers: A Framework to Detect Adverse Drug Reactions Using BERT Fine-Tuned with FARM
por: Hussain, Sajid, et al.
Publicado: (2021)

Modified Bidirectional Encoder Representations From Transformers Extractive Summarization Model for Hospital Information Systems Based on Character-Level Tokens (AlphaBERT): Development and Performance Evaluation
por: Chen, Yen-Pin, et al.
Publicado: (2020)

Traditional Machine Learning Models and Bidirectional Encoder Representations From Transformer (BERT)–Based Automatic Classification of Tweets About Eating Disorders: Algorithm Development and Validation Study
por: Benítez-Andrades, José Alberto, et al.
Publicado: (2022)

Investigation of improving the pre-training and fine-tuning of BERT model for biomedical relation extraction
por: Su, Peng, et al.
Publicado: (2022)

Effectiveness of Fine-tuned BERT Model in Classification of Helpful and Unhelpful Online Customer Reviews
por: Bilal, Muhammad, et al.
Publicado: (2022)

BERT’s sentiment score for portfolio optimization: a fine-tuned view in Black and Litterman model
por: Colasanto, Francesco, et al.
Publicado: (2022)

Use of BERT (Bidirectional Encoder Representations from Transformers)-Based Deep Learning Method for Extracting Evidences in Chinese Radiology Reports: Development of a Computer-Aided Liver Cancer Diagnosis Framework
por: Liu, Honglei, et al.
Publicado: (2021)

The performance of BERT as data representation of text clustering
por: Subakti, Alvin, et al.
Publicado: (2022)

Relation Classification for Bleeding Events From Electronic Health Records Using Deep Learning Systems: An Empirical Study
por: Mitra, Avijit, et al.
Publicado: (2021)

Automatic detection of actionable radiology reports using bidirectional encoder representations from transformers
por: Nakamura, Yuta, et al.
Publicado: (2021)

PD-BertEDL: An Ensemble Deep Learning Method Using BERT and Multivariate Representation to Predict Peptide Detectability
por: Wang, Huiqing, et al.
Publicado: (2022)

To BERT or Not to BERT Dealing with Possible BERT Failures in an Entailment Task
por: Fialho, Pedro, et al.
Publicado: (2020)

An Improved BERT and Syntactic Dependency Representation Model for Sentiment Analysis
por: Liu, Wenfeng, et al.
Publicado: (2022)

A hybrid approach of Weighted Fine-Tuned BERT extraction with deep Siamese Bi – LSTM model for semantic text similarity identification
por: Viji, D., et al.
Publicado: (2022)

Automatic Detection of Hypoglycemic Events From the Electronic Health Record Notes of Diabetes Patients: Empirical Study
por: Jin, Yonghao, et al.
Publicado: (2019)

Discovering Thematically Coherent Biomedical Documents Using Contextualized Bidirectional Encoder Representations from Transformers-Based Clustering
por: Davagdorj, Khishigsuren, et al.
Publicado: (2022)

Acquisition of a Lexicon for Family History Information: Bidirectional Encoder Representations From Transformers–Assisted Sublanguage Analysis
por: Wang, Liwei, et al.
Publicado: (2023)

SMG-BERT: integrating stereoscopic information and chemical representation for molecular property prediction
por: Zhang, Jiahui, et al.
Publicado: (2023)

Expert Programmers Have Fine-Tuned Cortical Representations of Source Code
por: Ikutani, Yoshiharu, et al.
Publicado: (2021)

BERTrand—peptide:TCR binding prediction using Bidirectional Encoder Representations from Transformers augmented with random TCR pairing
por: Myronov, Alexander, et al.
Publicado: (2023)

VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classification
por: Lu, Zhibin, et al.
Publicado: (2020)

IUP-BERT: Identification of Umami Peptides Based on BERT Features
por: Jiang, Liangzhen, et al.
Publicado: (2022)

CharAs-CBert: Character Assist Construction-Bert Sentence Representation Improving Sentiment Classification
por: Chen, Bo, et al.
Publicado: (2022)

Knowledge Graph Completion for the Chinese Text of Cultural Relics Based on Bidirectional Encoder Representations from Transformers with Entity-Type Information
por: Zhang, Min, et al.
Publicado: (2020)

TransformEHR: transformer-based encoder-decoder generative model to enhance prediction of disease outcomes using electronic health records
por: Yang, Zhichao, et al.
Publicado: (2023)

Phase-tuned neuronal firing encodes human contextual representations for navigational goals
por: Watrous, Andrew J, et al.
Publicado: (2018)

BioBERT: a pre-trained biomedical language representation model for biomedical text mining
por: Lee, Jinhyuk, et al.
Publicado: (2020)

A Natural Language Processing Model for COVID-19 Detection Based on Dutch General Practice Electronic Health Records by Using Bidirectional Encoder Representations From Transformers: Development and Validation Study
por: Homburg, Maarten, et al.
Publicado: (2023)

Fusion-ConvBERT: Parallel Convolution and BERT Fusion for Speech Emotion Recognition
por: Lee, Sanghyun, et al.
Publicado: (2020)

Cannot write session to /tmp/vufind_sessions/sess_d0pvu03tp0ei8mjpq854rc63qg