Cargando…

Heuristic Attention Representation Learning for Self-Supervised Pretraining

Recently, self-supervised learning methods have been shown to be very powerful and efficient for yielding robust representation learning by maximizing the similarity across different augmented views in embedding vector space. However, the main challenge is generating different views with random crop...

Descripción completa

Detalles Bibliográficos
Autores principales:	Tran, Van Nhiem, Liu, Shen-Hsuan, Li, Yung-Hui, Wang, Jia-Ching
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	MDPI 2022
Materias:	Article
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9320898/ https://www.ncbi.nlm.nih.gov/pubmed/35890847 http://dx.doi.org/10.3390/s22145169

Ejemplares similares

Self-Supervised Learning-Based General Laboratory Progress Pretrained Model for Cardiovascular Event Detection
Publicado: (2023)

Self-supervised pretraining improves the performance of classification of task functional magnetic resonance imaging
por: Shi, Chenwei, et al.
Publicado: (2023)

MAE-Based Self-Supervised Pretraining Algorithm for Heart Rate Estimation of Radar Signals
por: Xiang, Yashan, et al.
Publicado: (2023)

Self-Supervised Learning Framework toward State-of-the-Art Iris Image Segmentation
por: Putri, Wenny Ramadha, et al.
Publicado: (2022)

Contrastive learning-based pretraining improves representation and transferability of diabetic retinopathy classification models
por: Alam, Minhaj Nur, et al.
Publicado: (2023)

Self-supervised representation learning for surgical activity recognition
por: Paysan, Daniel, et al.
Publicado: (2021)

To pretrain or not? A systematic analysis of the benefits of pretraining in diabetic retinopathy
por: Srinivasan, Vignesh, et al.
Publicado: (2022)

Graph Multihead Attention Pooling with Self-Supervised Learning
por: Wang, Yu, et al.
Publicado: (2022)

Comparative Analysis on Alignment-Based and Pretrained Feature Representations for the Identification of DNA-Binding Proteins
por: Chen, Die, et al.
Publicado: (2022)

PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining
por: Wei, Bingcai, et al.
Publicado: (2022)

Self-Supervised Action Representation Learning Based on Asymmetric Skeleton Data Augmentation
por: Zhou, Hualing, et al.
Publicado: (2022)

C2RL: Convolutional-Contrastive Learning for Reinforcement Learning Based on Self-Pretraining for Strong Augmentation
por: Park, Sanghoon, et al.
Publicado: (2023)

Detection of maternal and fetal stress from the electrocardiogram with self-supervised representation learning
por: Sarkar, Pritam, et al.
Publicado: (2021)

Applying Self-Supervised Representation Learning for Emotion Recognition Using Physiological Signals
por: Montero Quispe, Kevin G., et al.
Publicado: (2022)

Cough event classification by pretrained deep neural network
por: Liu, Jia-Ming, et al.
Publicado: (2015)

Document-Level Biomedical Relation Extraction Leveraging Pretrained Self-Attention Structure and Entity Replacement: Algorithm and Pretreatment Method Validation Study
por: Liu, Xiaofeng, et al.
Publicado: (2020)

Discrete Infomax Codes for Supervised Representation Learning
por: Lee, Yoonho, et al.
Publicado: (2022)

Supervised Filter Learning for Representation Based Face Recognition
por: Bi, Chao, et al.
Publicado: (2016)

N-GPETS: Neural Attention Graph-Based Pretrained Statistical Model for Extractive Text Summarization
por: Umair, Muhammad, et al.
Publicado: (2022)

A self-supervised domain-general learning framework for human ventral stream representation
por: Konkle, Talia, et al.
Publicado: (2022)

Accurate prediction of molecular targets using a self-supervised image representation learning framework
por: Zeng, Xiangxiang, et al.
Publicado: (2022)

Enhanced Tooth Region Detection Using Pretrained Deep Learning Models
por: Al-Sarem, Mohammed, et al.
Publicado: (2022)

An intelligent detection method for plasmodium based on self-supervised learning and attention mechanism
por: Fu, Min, et al.
Publicado: (2023)

An Improved Math Word Problem (MWP) Model Using Unified Pretrained Language Model (UniLM) for Pretraining
por: Zhang, Dongqiu, et al.
Publicado: (2022)

Magnetic Tile Surface Defect Detection Methodology Based on Self-Attention and Self-Supervised Learning
por: Ling, Xufeng, et al.
Publicado: (2022)

A self-supervised contrastive learning approach for whole slide image representation in digital pathology
por: Fashi, Parsa Ashrafi, et al.
Publicado: (2022)

Contrastive self-supervised representation learning without negative samples for multimodal human action recognition
por: Yang, Huaigang, et al.
Publicado: (2023)

Self-supervised graph representation learning integrates multiple molecular networks and decodes gene-disease relationships
por: Wang, Yi, et al.
Publicado: (2022)

An Empirical Analysis of an Optimized Pretrained Deep Learning Model for COVID-19 Diagnosis
por: Sangeetha, S. K. B., et al.
Publicado: (2022)

Visual Pretraining via Contrastive Predictive Model for Pixel-Based Reinforcement Learning
por: Luu, Tung M., et al.
Publicado: (2022)

Assessment of emerging pretraining strategies in interpretable multimodal deep learning for cancer prognostication
por: Azher, Zarif L., et al.
Publicado: (2023)

Generative pretraining from large-scale transcriptomes for single-cell deciphering
por: Shen, Hongru, et al.
Publicado: (2023)

Self-supervised attention-based deep learning for pan-cancer mutation prediction from histopathology
por: Saldanha, Oliver Lester, et al.
Publicado: (2023)

Retracted: Magnetic Tile Surface Defect Detection Methodology Based on Self-Attention and Self-Supervised Learning
por: Intelligence and Neuroscience, Computational
Publicado: (2023)

Self-supervised recurrent depth estimation with attention mechanisms
por: Makarov, Ilya, et al.
Publicado: (2022)

Pretrained Transformer Language Models Versus Pretrained Word Embeddings for the Detection of Accurate Health Information on Arabic Social Media: Comparative Study
por: Albalawi, Yahya, et al.
Publicado: (2022)

A Pretraining-Retraining Strategy of Deep Learning Improves Cell-Specific Enhancer Predictions
por: Niu, Xiaohui, et al.
Publicado: (2020)

Improving machine learning performance on small chemical reaction data with unsupervised contrastive pretraining
por: Wen, Mingjian, et al.
Publicado: (2022)

Prediction of Antifungal Activity of Antimicrobial Peptides by Transfer Learning from Protein Pretrained Models
por: Lobo, Fernando, et al.
Publicado: (2023)

Automatic segmentation of nasopharyngeal carcinoma on CT images using efficient UNet‐2.5D ensemble with semi‐supervised pretext task pretraining
por: Domoguen, Jansen Keith L., et al.
Publicado: (2022)

Cannot write session to /tmp/vufind_sessions/sess_rd35kav5n5h0j44cja2sj9664q