Cargando…

Investigation of improving the pre-training and fine-tuning of BERT model for biomedical relation extraction

BACKGROUND: Recently, automatically extracting biomedical relations has been a significant subject in biomedical research due to the rapid growth of biomedical literature. Since the adaptation to the biomedical domain, the transformer-based BERT models have produced leading results on many biomedica...

Descripción completa

Detalles Bibliográficos
Autores principales:	Su, Peng, Vijay-Shanker, K.
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	BioMed Central 2022
Materias:	Research
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8978438/ https://www.ncbi.nlm.nih.gov/pubmed/35379166 http://dx.doi.org/10.1186/s12859-022-04642-w

Ejemplares similares

BioBERT: a pre-trained biomedical language representation model for biomedical text mining
por: Lee, Jinhyuk, et al.
Publicado: (2020)

Fine-tuning of BERT Model to Accurately Predict Drug–Target Interactions
por: Kang, Hyeunseok, et al.
Publicado: (2022)

Fine-Tuning BERT Models to Classify Misinformation on Garlic and COVID-19 on Twitter
por: Kim, Myeong Gyu, et al.
Publicado: (2022)

Effectiveness of Fine-tuned BERT Model in Classification of Helpful and Unhelpful Online Customer Reviews
por: Bilal, Muhammad, et al.
Publicado: (2022)

A Fine-Tuned BERT-Based Transfer Learning Approach for Text Classification
por: Qasim, Rukhma, et al.
Publicado: (2022)

Transfer Learning for Sentiment Analysis Using BERT Based Supervised Fine-Tuning
por: Prottasha, Nusrat Jahan, et al.
Publicado: (2022)

BERT’s sentiment score for portfolio optimization: a fine-tuned view in Black and Litterman model
por: Colasanto, Francesco, et al.
Publicado: (2022)

Trajectory-BERT: Trajectory Estimation Based on BERT Trajectory Pre-Training Model and Particle Filter Algorithm
por: Wu, You, et al.
Publicado: (2023)

Dependency parsing of biomedical text with BERT
por: Kanerva, Jenna, et al.
Publicado: (2020)

A hybrid approach of Weighted Fine-Tuned BERT extraction with deep Siamese Bi – LSTM model for semantic text similarity identification
por: Viji, D., et al.
Publicado: (2022)

A general approach for improving deep learning-based medical relation extraction using a pre-trained model and fine-tuning
por: Chen, Tao, et al.
Publicado: (2019)

Pharmacovigilance with Transformers: A Framework to Detect Adverse Drug Reactions Using BERT Fine-Tuned with FARM
por: Hussain, Sajid, et al.
Publicado: (2021)

Extraction of causal relations based on SBEL and BERT model
por: Shao, Yifan, et al.
Publicado: (2021)

Investigation of the BERT model on nucleotide sequences with non-standard pre-training and evaluation of different k-mer embeddings
por: Zhang, Yao-zhong, et al.
Publicado: (2023)

A pre-trained BERT for Korean medical natural language processing
por: Kim, Yoojoong, et al.
Publicado: (2022)

To BERT or Not to BERT Dealing with Possible BERT Failures in an Entailment Task
por: Fialho, Pedro, et al.
Publicado: (2020)

A generalizable NLP framework for fast development of pattern-based biomedical relation extraction systems
por: Peng, Yifan, et al.
Publicado: (2014)

Fine-Tuning Bidirectional Encoder Representations From Transformers (BERT)–Based Models on Large-Scale Electronic Health Record Notes: An Empirical Study
por: Li, Fei, et al.
Publicado: (2019)

Protected Health Information Recognition by Fine-Tuning a Pre-training Transformer Model
por: Oh, Seo Hyun, et al.
Publicado: (2022)

Author Correction: A pre-trained BERT for Korean medical natural language processing
por: Kim, Yoojoong, et al.
Publicado: (2023)

An efficient ptychography reconstruction strategy through fine-tuning of large pre-trained deep learning model
por: Pan, Xinyu, et al.
Publicado: (2023)

Fine-tuning large neural language models for biomedical natural language processing
por: Tinn, Robert, et al.
Publicado: (2023)

Predicting medical specialty from text based on a domain-specific pre-trained BERT
por: Kim, Yoojoong, et al.
Publicado: (2023)

Gold nanocrystals: optical properties, fine-tuning of the shape, and biomedical applications
por: Li, Meng, et al.
Publicado: (2022)

srBERT: automatic article classification model for systematic review using BERT
por: Aum, Sungmin, et al.
Publicado: (2021)

VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classification
por: Lu, Zhibin, et al.
Publicado: (2020)

IUP-BERT: Identification of Umami Peptides Based on BERT Features
por: Jiang, Liangzhen, et al.
Publicado: (2022)

An integrated clustering and BERT framework for improved topic modeling
por: George, Lijimol, et al.
Publicado: (2023)

Mechanics to pre-process information for the fine tuning of mechanoreceptors
por: Barth, Friedrich G.
Publicado: (2019)

Training Deep Spiking Convolutional Neural Networks With STDP-Based Unsupervised Pre-training Followed by Supervised Fine-Tuning
por: Lee, Chankyu, et al.
Publicado: (2018)

Investigating Query Expansion and Coreference Resolution in Question Answering on BERT
por: Bhattacharjee, Santanu, et al.
Publicado: (2020)

An Improved BERT and Syntactic Dependency Representation Model for Sentiment Analysis
por: Liu, Wenfeng, et al.
Publicado: (2022)

Fusion-ConvBERT: Parallel Convolution and BERT Fusion for Speech Emotion Recognition
por: Lee, Sanghyun, et al.
Publicado: (2020)

Pre-Training on In Vitro and Fine-Tuning on Patient-Derived Data Improves Deep Neural Networks for Anti-Cancer Drug-Sensitivity Prediction
por: Prasse, Paul, et al.
Publicado: (2022)

Pre-Big-Bang inflation is as fine-tuned as gravitational collapse
por: Veneziano, Gabriele
Publicado: (1998)

Advancing Brain Tumor Classification through Fine-Tuned Vision Transformers: A Comparative Study of Pre-Trained Models
por: Asiri, Abdullah A., et al.
Publicado: (2023)

BERT-Based Approaches to Identifying Malicious URLs
por: Su, Ming-Yang, et al.
Publicado: (2023)

BERT-PPII: The Polyproline Type II Helix Structure Prediction Model Based on BERT and Multichannel CNN
por: Feng, Chuang, et al.
Publicado: (2022)

BertSRC: transformer-based semantic relation classification
por: Lee, Yeawon, et al.
Publicado: (2022)

Tuning and Fine-Tuning of Synapses with Adenosine
por: Sebastião, A.M, et al.
Publicado: (2009)

Cannot write session to /tmp/vufind_sessions/sess_cav3vovjnfuknmrt16ejhq59m4