Cargando…

Automatic detection of multilayer hexagonal boron nitride in optical images using deep learning-based computer vision

Computer vision algorithms can quickly analyze numerous images and identify useful information with high accuracy. Recently, computer vision has been used to identify 2D materials in microscope images. 2D materials have important fundamental properties allowing for their use in many potential applic...

Descripción completa

Detalles Bibliográficos
Autores principales: Ramezani, Fereshteh, Parvez, Sheikh, Fix, J. Pierce, Battaglin, Arthur, Whyte, Seamus, Borys, Nicholas J., Whitaker, Bradley M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9884302/
https://www.ncbi.nlm.nih.gov/pubmed/36709225
http://dx.doi.org/10.1038/s41598-023-28664-3
_version_ 1784879689433612288
author Ramezani, Fereshteh
Parvez, Sheikh
Fix, J. Pierce
Battaglin, Arthur
Whyte, Seamus
Borys, Nicholas J.
Whitaker, Bradley M.
author_facet Ramezani, Fereshteh
Parvez, Sheikh
Fix, J. Pierce
Battaglin, Arthur
Whyte, Seamus
Borys, Nicholas J.
Whitaker, Bradley M.
author_sort Ramezani, Fereshteh
collection PubMed
description Computer vision algorithms can quickly analyze numerous images and identify useful information with high accuracy. Recently, computer vision has been used to identify 2D materials in microscope images. 2D materials have important fundamental properties allowing for their use in many potential applications, including many in quantum information science and engineering. One such material is hexagonal boron nitride (hBN), an isomorph of graphene with a very indistinguishable layered structure. In order to use these materials for research and product development, the most effective method is mechanical exfoliation where single-layer 2D crystallites must be prepared through an exfoliation procedure and then identified using reflected light optical microscopy. Performing these searches manually is a time-consuming and tedious task. Deploying deep learning-based computer vision algorithms for 2D material search can automate the flake detection task with minimal need for human intervention. In this work, we have implemented a new deep learning pipeline to classify crystallites of hBN based on coarse thickness classifications in reflected-light optical micrographs. We have used DetectoRS as the object detector and trained it on 177 images containing hexagonal boron nitride (hBN) flakes of varying thickness. The trained model achieved a high detection accuracy for the rare category of thin flakes ([Formula: see text] atomic layers thick). Further analysis shows that our proposed pipeline could be generalized to various microscope settings and is robust against changes in color or substrate background.
format Online
Article
Text
id pubmed-9884302
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-98843022023-01-30 Automatic detection of multilayer hexagonal boron nitride in optical images using deep learning-based computer vision Ramezani, Fereshteh Parvez, Sheikh Fix, J. Pierce Battaglin, Arthur Whyte, Seamus Borys, Nicholas J. Whitaker, Bradley M. Sci Rep Article Computer vision algorithms can quickly analyze numerous images and identify useful information with high accuracy. Recently, computer vision has been used to identify 2D materials in microscope images. 2D materials have important fundamental properties allowing for their use in many potential applications, including many in quantum information science and engineering. One such material is hexagonal boron nitride (hBN), an isomorph of graphene with a very indistinguishable layered structure. In order to use these materials for research and product development, the most effective method is mechanical exfoliation where single-layer 2D crystallites must be prepared through an exfoliation procedure and then identified using reflected light optical microscopy. Performing these searches manually is a time-consuming and tedious task. Deploying deep learning-based computer vision algorithms for 2D material search can automate the flake detection task with minimal need for human intervention. In this work, we have implemented a new deep learning pipeline to classify crystallites of hBN based on coarse thickness classifications in reflected-light optical micrographs. We have used DetectoRS as the object detector and trained it on 177 images containing hexagonal boron nitride (hBN) flakes of varying thickness. The trained model achieved a high detection accuracy for the rare category of thin flakes ([Formula: see text] atomic layers thick). Further analysis shows that our proposed pipeline could be generalized to various microscope settings and is robust against changes in color or substrate background. Nature Publishing Group UK 2023-01-28 /pmc/articles/PMC9884302/ /pubmed/36709225 http://dx.doi.org/10.1038/s41598-023-28664-3 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Ramezani, Fereshteh
Parvez, Sheikh
Fix, J. Pierce
Battaglin, Arthur
Whyte, Seamus
Borys, Nicholas J.
Whitaker, Bradley M.
Automatic detection of multilayer hexagonal boron nitride in optical images using deep learning-based computer vision
title Automatic detection of multilayer hexagonal boron nitride in optical images using deep learning-based computer vision
title_full Automatic detection of multilayer hexagonal boron nitride in optical images using deep learning-based computer vision
title_fullStr Automatic detection of multilayer hexagonal boron nitride in optical images using deep learning-based computer vision
title_full_unstemmed Automatic detection of multilayer hexagonal boron nitride in optical images using deep learning-based computer vision
title_short Automatic detection of multilayer hexagonal boron nitride in optical images using deep learning-based computer vision
title_sort automatic detection of multilayer hexagonal boron nitride in optical images using deep learning-based computer vision
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9884302/
https://www.ncbi.nlm.nih.gov/pubmed/36709225
http://dx.doi.org/10.1038/s41598-023-28664-3
work_keys_str_mv AT ramezanifereshteh automaticdetectionofmultilayerhexagonalboronnitrideinopticalimagesusingdeeplearningbasedcomputervision
AT parvezsheikh automaticdetectionofmultilayerhexagonalboronnitrideinopticalimagesusingdeeplearningbasedcomputervision
AT fixjpierce automaticdetectionofmultilayerhexagonalboronnitrideinopticalimagesusingdeeplearningbasedcomputervision
AT battaglinarthur automaticdetectionofmultilayerhexagonalboronnitrideinopticalimagesusingdeeplearningbasedcomputervision
AT whyteseamus automaticdetectionofmultilayerhexagonalboronnitrideinopticalimagesusingdeeplearningbasedcomputervision
AT borysnicholasj automaticdetectionofmultilayerhexagonalboronnitrideinopticalimagesusingdeeplearningbasedcomputervision
AT whitakerbradleym automaticdetectionofmultilayerhexagonalboronnitrideinopticalimagesusingdeeplearningbasedcomputervision