Cargando…

Deep autoencoder based domain adaptation for transfer learning

The concept of transfer learning has received a great deal of concern and interest throughout the last decade. Selecting an ideal representational framework for instances of various domains to minimize the divergence among source and target domains is a fundamental research challenge in representati...

Descripción completa

Detalles Bibliográficos
Autores principales: Dev, Krishna, Ashraf, Zubair, Muhuri, Pranab K., Kumar, Sandeep
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8923974/
https://www.ncbi.nlm.nih.gov/pubmed/35310888
http://dx.doi.org/10.1007/s11042-022-12226-2
_version_ 1784669751516069888
author Dev, Krishna
Ashraf, Zubair
Muhuri, Pranab K.
Kumar, Sandeep
author_facet Dev, Krishna
Ashraf, Zubair
Muhuri, Pranab K.
Kumar, Sandeep
author_sort Dev, Krishna
collection PubMed
description The concept of transfer learning has received a great deal of concern and interest throughout the last decade. Selecting an ideal representational framework for instances of various domains to minimize the divergence among source and target domains is a fundamental research challenge in representative transfer learning. The domain adaptation approach is designed to learn more robust or higher-level features, required in transfer learning. This paper presents a novel transfer learning framework that employs a marginal probability-based domain adaptation methodology followed by a deep autoencoder. The proposed frame adapts the source and target domain by plummeting distribution deviation between the features of both domains. Further, we adopt the deep neural network process to transfer learning and suggest a supervised learning algorithm based on encoding and decoding layer architecture. Moreover, we have proposed two different variants of the transfer learning techniques for classification, which are termed as (i) Domain adapted transfer learning with deep autoencoder-1 (D-TLDA-1) using the linear regression and (ii) Domain adapted transfer learning with deep autoencoder-2 (D-TLDA-2) using softmax regression. Simulations have been conducted with two popular real-world datasets: ImageNet datasets for image classification problem and 20_Newsgroups datasets for text classification problem. Experimental findings have established and the resulting improvements in accuracy measure of classification shows the supremacy of the proposed D-TLDA framework over prominent state-of-the-art machine learning and transfer learning approaches.
format Online
Article
Text
id pubmed-8923974
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-89239742022-03-16 Deep autoencoder based domain adaptation for transfer learning Dev, Krishna Ashraf, Zubair Muhuri, Pranab K. Kumar, Sandeep Multimed Tools Appl 1200: Machine Vision Theory and Applications for Cyber Physical Systems The concept of transfer learning has received a great deal of concern and interest throughout the last decade. Selecting an ideal representational framework for instances of various domains to minimize the divergence among source and target domains is a fundamental research challenge in representative transfer learning. The domain adaptation approach is designed to learn more robust or higher-level features, required in transfer learning. This paper presents a novel transfer learning framework that employs a marginal probability-based domain adaptation methodology followed by a deep autoencoder. The proposed frame adapts the source and target domain by plummeting distribution deviation between the features of both domains. Further, we adopt the deep neural network process to transfer learning and suggest a supervised learning algorithm based on encoding and decoding layer architecture. Moreover, we have proposed two different variants of the transfer learning techniques for classification, which are termed as (i) Domain adapted transfer learning with deep autoencoder-1 (D-TLDA-1) using the linear regression and (ii) Domain adapted transfer learning with deep autoencoder-2 (D-TLDA-2) using softmax regression. Simulations have been conducted with two popular real-world datasets: ImageNet datasets for image classification problem and 20_Newsgroups datasets for text classification problem. Experimental findings have established and the resulting improvements in accuracy measure of classification shows the supremacy of the proposed D-TLDA framework over prominent state-of-the-art machine learning and transfer learning approaches. Springer US 2022-03-16 2022 /pmc/articles/PMC8923974/ /pubmed/35310888 http://dx.doi.org/10.1007/s11042-022-12226-2 Text en © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle 1200: Machine Vision Theory and Applications for Cyber Physical Systems
Dev, Krishna
Ashraf, Zubair
Muhuri, Pranab K.
Kumar, Sandeep
Deep autoencoder based domain adaptation for transfer learning
title Deep autoencoder based domain adaptation for transfer learning
title_full Deep autoencoder based domain adaptation for transfer learning
title_fullStr Deep autoencoder based domain adaptation for transfer learning
title_full_unstemmed Deep autoencoder based domain adaptation for transfer learning
title_short Deep autoencoder based domain adaptation for transfer learning
title_sort deep autoencoder based domain adaptation for transfer learning
topic 1200: Machine Vision Theory and Applications for Cyber Physical Systems
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8923974/
https://www.ncbi.nlm.nih.gov/pubmed/35310888
http://dx.doi.org/10.1007/s11042-022-12226-2
work_keys_str_mv AT devkrishna deepautoencoderbaseddomainadaptationfortransferlearning
AT ashrafzubair deepautoencoderbaseddomainadaptationfortransferlearning
AT muhuripranabk deepautoencoderbaseddomainadaptationfortransferlearning
AT kumarsandeep deepautoencoderbaseddomainadaptationfortransferlearning