Cargando…
HVGH: Unsupervised Segmentation for High-Dimensional Time Series Using Deep Neural Compression and Statistical Generative Model
Humans perceive continuous high-dimensional information by dividing it into meaningful segments, such as words and units of motion. We believe that such unsupervised segmentation is also important for robots to learn topics such as language and motion. To this end, we previously proposed a hierarchi...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7805757/ https://www.ncbi.nlm.nih.gov/pubmed/33501130 http://dx.doi.org/10.3389/frobt.2019.00115 |
_version_ | 1783636374276014080 |
---|---|
author | Nagano, Masatoshi Nakamura, Tomoaki Nagai, Takayuki Mochihashi, Daichi Kobayashi, Ichiro Takano, Wataru |
author_facet | Nagano, Masatoshi Nakamura, Tomoaki Nagai, Takayuki Mochihashi, Daichi Kobayashi, Ichiro Takano, Wataru |
author_sort | Nagano, Masatoshi |
collection | PubMed |
description | Humans perceive continuous high-dimensional information by dividing it into meaningful segments, such as words and units of motion. We believe that such unsupervised segmentation is also important for robots to learn topics such as language and motion. To this end, we previously proposed a hierarchical Dirichlet process–Gaussian process–hidden semi-Markov model (HDP-GP-HSMM). However, an important drawback of this model is that it cannot divide high-dimensional time-series data. Furthermore, low-dimensional features must be extracted in advance. Segmentation largely depends on the design of features, and it is difficult to design effective features, especially in the case of high-dimensional data. To overcome this problem, this study proposes a hierarchical Dirichlet process–variational autoencoder–Gaussian process–hidden semi-Markov model (HVGH). The parameters of the proposed HVGH are estimated through a mutual learning loop of the variational autoencoder and our previously proposed HDP-GP-HSMM. Hence, HVGH can extract features from high-dimensional time-series data while simultaneously dividing it into segments in an unsupervised manner. In an experiment, we used various motion-capture data to demonstrate that our proposed model estimates the correct number of classes and more accurate segments than baseline methods. Moreover, we show that the proposed method can learn latent space suitable for segmentation. |
format | Online Article Text |
id | pubmed-7805757 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-78057572021-01-25 HVGH: Unsupervised Segmentation for High-Dimensional Time Series Using Deep Neural Compression and Statistical Generative Model Nagano, Masatoshi Nakamura, Tomoaki Nagai, Takayuki Mochihashi, Daichi Kobayashi, Ichiro Takano, Wataru Front Robot AI Robotics and AI Humans perceive continuous high-dimensional information by dividing it into meaningful segments, such as words and units of motion. We believe that such unsupervised segmentation is also important for robots to learn topics such as language and motion. To this end, we previously proposed a hierarchical Dirichlet process–Gaussian process–hidden semi-Markov model (HDP-GP-HSMM). However, an important drawback of this model is that it cannot divide high-dimensional time-series data. Furthermore, low-dimensional features must be extracted in advance. Segmentation largely depends on the design of features, and it is difficult to design effective features, especially in the case of high-dimensional data. To overcome this problem, this study proposes a hierarchical Dirichlet process–variational autoencoder–Gaussian process–hidden semi-Markov model (HVGH). The parameters of the proposed HVGH are estimated through a mutual learning loop of the variational autoencoder and our previously proposed HDP-GP-HSMM. Hence, HVGH can extract features from high-dimensional time-series data while simultaneously dividing it into segments in an unsupervised manner. In an experiment, we used various motion-capture data to demonstrate that our proposed model estimates the correct number of classes and more accurate segments than baseline methods. Moreover, we show that the proposed method can learn latent space suitable for segmentation. Frontiers Media S.A. 2019-11-20 /pmc/articles/PMC7805757/ /pubmed/33501130 http://dx.doi.org/10.3389/frobt.2019.00115 Text en Copyright © 2019 Nagano, Nakamura, Nagai, Mochihashi, Kobayashi and Takano. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Robotics and AI Nagano, Masatoshi Nakamura, Tomoaki Nagai, Takayuki Mochihashi, Daichi Kobayashi, Ichiro Takano, Wataru HVGH: Unsupervised Segmentation for High-Dimensional Time Series Using Deep Neural Compression and Statistical Generative Model |
title | HVGH: Unsupervised Segmentation for High-Dimensional Time Series Using Deep Neural Compression and Statistical Generative Model |
title_full | HVGH: Unsupervised Segmentation for High-Dimensional Time Series Using Deep Neural Compression and Statistical Generative Model |
title_fullStr | HVGH: Unsupervised Segmentation for High-Dimensional Time Series Using Deep Neural Compression and Statistical Generative Model |
title_full_unstemmed | HVGH: Unsupervised Segmentation for High-Dimensional Time Series Using Deep Neural Compression and Statistical Generative Model |
title_short | HVGH: Unsupervised Segmentation for High-Dimensional Time Series Using Deep Neural Compression and Statistical Generative Model |
title_sort | hvgh: unsupervised segmentation for high-dimensional time series using deep neural compression and statistical generative model |
topic | Robotics and AI |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7805757/ https://www.ncbi.nlm.nih.gov/pubmed/33501130 http://dx.doi.org/10.3389/frobt.2019.00115 |
work_keys_str_mv | AT naganomasatoshi hvghunsupervisedsegmentationforhighdimensionaltimeseriesusingdeepneuralcompressionandstatisticalgenerativemodel AT nakamuratomoaki hvghunsupervisedsegmentationforhighdimensionaltimeseriesusingdeepneuralcompressionandstatisticalgenerativemodel AT nagaitakayuki hvghunsupervisedsegmentationforhighdimensionaltimeseriesusingdeepneuralcompressionandstatisticalgenerativemodel AT mochihashidaichi hvghunsupervisedsegmentationforhighdimensionaltimeseriesusingdeepneuralcompressionandstatisticalgenerativemodel AT kobayashiichiro hvghunsupervisedsegmentationforhighdimensionaltimeseriesusingdeepneuralcompressionandstatisticalgenerativemodel AT takanowataru hvghunsupervisedsegmentationforhighdimensionaltimeseriesusingdeepneuralcompressionandstatisticalgenerativemodel |