Cargando…

A Novel Approach to Dining Bowl Reconstruction for Image-Based Food Volume Estimation

Knowing the amounts of energy and nutrients in an individual’s diet is important for maintaining health and preventing chronic diseases. As electronic and AI technologies advance rapidly, dietary assessment can now be performed using food images obtained from a smartphone or a wearable device. One o...

Descripción completa

Detalles Bibliográficos
Autores principales: Jia, Wenyan, Ren, Yiqiu, Li, Boyang, Beatrice, Britney, Que, Jingda, Cao, Shunxin, Wu, Zekun, Mao, Zhi-Hong, Lo, Benny, Anderson, Alex K., Frost, Gary, McCrory, Megan A., Sazonov, Edward, Steiner-Asiedu, Matilda, Baranowski, Tom, Burke, Lora E., Sun, Mingui
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8877095/
https://www.ncbi.nlm.nih.gov/pubmed/35214399
http://dx.doi.org/10.3390/s22041493
_version_ 1784658325570322432
author Jia, Wenyan
Ren, Yiqiu
Li, Boyang
Beatrice, Britney
Que, Jingda
Cao, Shunxin
Wu, Zekun
Mao, Zhi-Hong
Lo, Benny
Anderson, Alex K.
Frost, Gary
McCrory, Megan A.
Sazonov, Edward
Steiner-Asiedu, Matilda
Baranowski, Tom
Burke, Lora E.
Sun, Mingui
author_facet Jia, Wenyan
Ren, Yiqiu
Li, Boyang
Beatrice, Britney
Que, Jingda
Cao, Shunxin
Wu, Zekun
Mao, Zhi-Hong
Lo, Benny
Anderson, Alex K.
Frost, Gary
McCrory, Megan A.
Sazonov, Edward
Steiner-Asiedu, Matilda
Baranowski, Tom
Burke, Lora E.
Sun, Mingui
author_sort Jia, Wenyan
collection PubMed
description Knowing the amounts of energy and nutrients in an individual’s diet is important for maintaining health and preventing chronic diseases. As electronic and AI technologies advance rapidly, dietary assessment can now be performed using food images obtained from a smartphone or a wearable device. One of the challenges in this approach is to computationally measure the volume of food in a bowl from an image. This problem has not been studied systematically despite the bowl being the most utilized food container in many parts of the world, especially in Asia and Africa. In this paper, we present a new method to measure the size and shape of a bowl by adhering a paper ruler centrally across the bottom and sides of the bowl and then taking an image. When observed from the image, the distortions in the width of the paper ruler and the spacings between ruler markers completely encode the size and shape of the bowl. A computational algorithm is developed to reconstruct the three-dimensional bowl interior using the observed distortions. Our experiments using nine bowls, colored liquids, and amorphous foods demonstrate high accuracy of our method for food volume estimation involving round bowls as containers. A total of 228 images of amorphous foods were also used in a comparative experiment between our algorithm and an independent human estimator. The results showed that our algorithm overperformed the human estimator who utilized different types of reference information and two estimation methods, including direct volume estimation and indirect estimation through the fullness of the bowl.
format Online
Article
Text
id pubmed-8877095
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-88770952022-02-26 A Novel Approach to Dining Bowl Reconstruction for Image-Based Food Volume Estimation Jia, Wenyan Ren, Yiqiu Li, Boyang Beatrice, Britney Que, Jingda Cao, Shunxin Wu, Zekun Mao, Zhi-Hong Lo, Benny Anderson, Alex K. Frost, Gary McCrory, Megan A. Sazonov, Edward Steiner-Asiedu, Matilda Baranowski, Tom Burke, Lora E. Sun, Mingui Sensors (Basel) Article Knowing the amounts of energy and nutrients in an individual’s diet is important for maintaining health and preventing chronic diseases. As electronic and AI technologies advance rapidly, dietary assessment can now be performed using food images obtained from a smartphone or a wearable device. One of the challenges in this approach is to computationally measure the volume of food in a bowl from an image. This problem has not been studied systematically despite the bowl being the most utilized food container in many parts of the world, especially in Asia and Africa. In this paper, we present a new method to measure the size and shape of a bowl by adhering a paper ruler centrally across the bottom and sides of the bowl and then taking an image. When observed from the image, the distortions in the width of the paper ruler and the spacings between ruler markers completely encode the size and shape of the bowl. A computational algorithm is developed to reconstruct the three-dimensional bowl interior using the observed distortions. Our experiments using nine bowls, colored liquids, and amorphous foods demonstrate high accuracy of our method for food volume estimation involving round bowls as containers. A total of 228 images of amorphous foods were also used in a comparative experiment between our algorithm and an independent human estimator. The results showed that our algorithm overperformed the human estimator who utilized different types of reference information and two estimation methods, including direct volume estimation and indirect estimation through the fullness of the bowl. MDPI 2022-02-15 /pmc/articles/PMC8877095/ /pubmed/35214399 http://dx.doi.org/10.3390/s22041493 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Jia, Wenyan
Ren, Yiqiu
Li, Boyang
Beatrice, Britney
Que, Jingda
Cao, Shunxin
Wu, Zekun
Mao, Zhi-Hong
Lo, Benny
Anderson, Alex K.
Frost, Gary
McCrory, Megan A.
Sazonov, Edward
Steiner-Asiedu, Matilda
Baranowski, Tom
Burke, Lora E.
Sun, Mingui
A Novel Approach to Dining Bowl Reconstruction for Image-Based Food Volume Estimation
title A Novel Approach to Dining Bowl Reconstruction for Image-Based Food Volume Estimation
title_full A Novel Approach to Dining Bowl Reconstruction for Image-Based Food Volume Estimation
title_fullStr A Novel Approach to Dining Bowl Reconstruction for Image-Based Food Volume Estimation
title_full_unstemmed A Novel Approach to Dining Bowl Reconstruction for Image-Based Food Volume Estimation
title_short A Novel Approach to Dining Bowl Reconstruction for Image-Based Food Volume Estimation
title_sort novel approach to dining bowl reconstruction for image-based food volume estimation
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8877095/
https://www.ncbi.nlm.nih.gov/pubmed/35214399
http://dx.doi.org/10.3390/s22041493
work_keys_str_mv AT jiawenyan anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT renyiqiu anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT liboyang anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT beatricebritney anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT quejingda anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT caoshunxin anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT wuzekun anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT maozhihong anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT lobenny anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT andersonalexk anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT frostgary anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT mccrorymegana anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT sazonovedward anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT steinerasiedumatilda anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT baranowskitom anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT burkelorae anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT sunmingui anovelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT jiawenyan novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT renyiqiu novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT liboyang novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT beatricebritney novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT quejingda novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT caoshunxin novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT wuzekun novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT maozhihong novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT lobenny novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT andersonalexk novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT frostgary novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT mccrorymegana novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT sazonovedward novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT steinerasiedumatilda novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT baranowskitom novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT burkelorae novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation
AT sunmingui novelapproachtodiningbowlreconstructionforimagebasedfoodvolumeestimation