Cargando…

Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data

Artificial intelligence (AI) and machine learning (ML) have been increasingly used in materials science to build predictive models and accelerate discovery. For selected properties, availability of large databases has also facilitated application of deep learning (DL) and transfer learning (TL). How...

Descripción completa

Detalles Bibliográficos
Autores principales: Gupta, Vishu, Choudhary, Kamal, Tavazza, Francesca, Campbell, Carelyn, Liao, Wei-keng, Choudhary, Alok, Agrawal, Ankit
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8594437/
https://www.ncbi.nlm.nih.gov/pubmed/34782631
http://dx.doi.org/10.1038/s41467-021-26921-5
_version_ 1784599994848772096
author Gupta, Vishu
Choudhary, Kamal
Tavazza, Francesca
Campbell, Carelyn
Liao, Wei-keng
Choudhary, Alok
Agrawal, Ankit
author_facet Gupta, Vishu
Choudhary, Kamal
Tavazza, Francesca
Campbell, Carelyn
Liao, Wei-keng
Choudhary, Alok
Agrawal, Ankit
author_sort Gupta, Vishu
collection PubMed
description Artificial intelligence (AI) and machine learning (ML) have been increasingly used in materials science to build predictive models and accelerate discovery. For selected properties, availability of large databases has also facilitated application of deep learning (DL) and transfer learning (TL). However, unavailability of large datasets for a majority of properties prohibits widespread application of DL/TL. We present a cross-property deep-transfer-learning framework that leverages models trained on large datasets to build models on small datasets of different properties. We test the proposed framework on 39 computational and two experimental datasets and find that the TL models with only elemental fractions as input outperform ML/DL models trained from scratch even when they are allowed to use physical attributes as input, for 27/39 (≈ 69%) computational and both the experimental datasets. We believe that the proposed framework can be widely useful to tackle the small data challenge in applying AI/ML in materials science.
format Online
Article
Text
id pubmed-8594437
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-85944372021-11-19 Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data Gupta, Vishu Choudhary, Kamal Tavazza, Francesca Campbell, Carelyn Liao, Wei-keng Choudhary, Alok Agrawal, Ankit Nat Commun Article Artificial intelligence (AI) and machine learning (ML) have been increasingly used in materials science to build predictive models and accelerate discovery. For selected properties, availability of large databases has also facilitated application of deep learning (DL) and transfer learning (TL). However, unavailability of large datasets for a majority of properties prohibits widespread application of DL/TL. We present a cross-property deep-transfer-learning framework that leverages models trained on large datasets to build models on small datasets of different properties. We test the proposed framework on 39 computational and two experimental datasets and find that the TL models with only elemental fractions as input outperform ML/DL models trained from scratch even when they are allowed to use physical attributes as input, for 27/39 (≈ 69%) computational and both the experimental datasets. We believe that the proposed framework can be widely useful to tackle the small data challenge in applying AI/ML in materials science. Nature Publishing Group UK 2021-11-15 /pmc/articles/PMC8594437/ /pubmed/34782631 http://dx.doi.org/10.1038/s41467-021-26921-5 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Gupta, Vishu
Choudhary, Kamal
Tavazza, Francesca
Campbell, Carelyn
Liao, Wei-keng
Choudhary, Alok
Agrawal, Ankit
Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data
title Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data
title_full Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data
title_fullStr Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data
title_full_unstemmed Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data
title_short Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data
title_sort cross-property deep transfer learning framework for enhanced predictive analytics on small materials data
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8594437/
https://www.ncbi.nlm.nih.gov/pubmed/34782631
http://dx.doi.org/10.1038/s41467-021-26921-5
work_keys_str_mv AT guptavishu crosspropertydeeptransferlearningframeworkforenhancedpredictiveanalyticsonsmallmaterialsdata
AT choudharykamal crosspropertydeeptransferlearningframeworkforenhancedpredictiveanalyticsonsmallmaterialsdata
AT tavazzafrancesca crosspropertydeeptransferlearningframeworkforenhancedpredictiveanalyticsonsmallmaterialsdata
AT campbellcarelyn crosspropertydeeptransferlearningframeworkforenhancedpredictiveanalyticsonsmallmaterialsdata
AT liaoweikeng crosspropertydeeptransferlearningframeworkforenhancedpredictiveanalyticsonsmallmaterialsdata
AT choudharyalok crosspropertydeeptransferlearningframeworkforenhancedpredictiveanalyticsonsmallmaterialsdata
AT agrawalankit crosspropertydeeptransferlearningframeworkforenhancedpredictiveanalyticsonsmallmaterialsdata