Cargando…
Self-supervised Learning for Semi-supervised Time Series Classification
Self-supervised learning is a promising new technique for learning representative features in the absence of manual annotations. It is particularly efficient in cases where labeling the training data is expensive and tedious, naturally linking it to the semi-supervised learning paradigm. In this wor...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7206263/ http://dx.doi.org/10.1007/978-3-030-47426-3_39 |
_version_ | 1783530380776701952 |
---|---|
author | Jawed, Shayan Grabocka, Josif Schmidt-Thieme, Lars |
author_facet | Jawed, Shayan Grabocka, Josif Schmidt-Thieme, Lars |
author_sort | Jawed, Shayan |
collection | PubMed |
description | Self-supervised learning is a promising new technique for learning representative features in the absence of manual annotations. It is particularly efficient in cases where labeling the training data is expensive and tedious, naturally linking it to the semi-supervised learning paradigm. In this work, we propose a new semi-supervised time series classification model that leverages features learned from the self-supervised task on unlabeled data. The idea is to exploit the unlabeled training data with a forecasting task which provides a strong surrogate supervision signal for feature learning. We draw from established multi-task learning approaches and model forecasting as an auxiliary task to be optimized jointly with the main task of classification. We evaluate our proposed method on benchmark time series classification datasets in semi-supervised setting and are able to show that it significantly outperforms the state-of-the-art baselines. |
format | Online Article Text |
id | pubmed-7206263 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
record_format | MEDLINE/PubMed |
spelling | pubmed-72062632020-05-08 Self-supervised Learning for Semi-supervised Time Series Classification Jawed, Shayan Grabocka, Josif Schmidt-Thieme, Lars Advances in Knowledge Discovery and Data Mining Article Self-supervised learning is a promising new technique for learning representative features in the absence of manual annotations. It is particularly efficient in cases where labeling the training data is expensive and tedious, naturally linking it to the semi-supervised learning paradigm. In this work, we propose a new semi-supervised time series classification model that leverages features learned from the self-supervised task on unlabeled data. The idea is to exploit the unlabeled training data with a forecasting task which provides a strong surrogate supervision signal for feature learning. We draw from established multi-task learning approaches and model forecasting as an auxiliary task to be optimized jointly with the main task of classification. We evaluate our proposed method on benchmark time series classification datasets in semi-supervised setting and are able to show that it significantly outperforms the state-of-the-art baselines. 2020-04-17 /pmc/articles/PMC7206263/ http://dx.doi.org/10.1007/978-3-030-47426-3_39 Text en © Springer Nature Switzerland AG 2020 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Article Jawed, Shayan Grabocka, Josif Schmidt-Thieme, Lars Self-supervised Learning for Semi-supervised Time Series Classification |
title | Self-supervised Learning for Semi-supervised Time Series Classification |
title_full | Self-supervised Learning for Semi-supervised Time Series Classification |
title_fullStr | Self-supervised Learning for Semi-supervised Time Series Classification |
title_full_unstemmed | Self-supervised Learning for Semi-supervised Time Series Classification |
title_short | Self-supervised Learning for Semi-supervised Time Series Classification |
title_sort | self-supervised learning for semi-supervised time series classification |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7206263/ http://dx.doi.org/10.1007/978-3-030-47426-3_39 |
work_keys_str_mv | AT jawedshayan selfsupervisedlearningforsemisupervisedtimeseriesclassification AT grabockajosif selfsupervisedlearningforsemisupervisedtimeseriesclassification AT schmidtthiemelars selfsupervisedlearningforsemisupervisedtimeseriesclassification |