Cargando…

Self-supervised Learning for Semi-supervised Time Series Classification

Self-supervised learning is a promising new technique for learning representative features in the absence of manual annotations. It is particularly efficient in cases where labeling the training data is expensive and tedious, naturally linking it to the semi-supervised learning paradigm. In this wor...

Descripción completa

Detalles Bibliográficos
Autores principales: Jawed, Shayan, Grabocka, Josif, Schmidt-Thieme, Lars
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7206263/
http://dx.doi.org/10.1007/978-3-030-47426-3_39
_version_ 1783530380776701952
author Jawed, Shayan
Grabocka, Josif
Schmidt-Thieme, Lars
author_facet Jawed, Shayan
Grabocka, Josif
Schmidt-Thieme, Lars
author_sort Jawed, Shayan
collection PubMed
description Self-supervised learning is a promising new technique for learning representative features in the absence of manual annotations. It is particularly efficient in cases where labeling the training data is expensive and tedious, naturally linking it to the semi-supervised learning paradigm. In this work, we propose a new semi-supervised time series classification model that leverages features learned from the self-supervised task on unlabeled data. The idea is to exploit the unlabeled training data with a forecasting task which provides a strong surrogate supervision signal for feature learning. We draw from established multi-task learning approaches and model forecasting as an auxiliary task to be optimized jointly with the main task of classification. We evaluate our proposed method on benchmark time series classification datasets in semi-supervised setting and are able to show that it significantly outperforms the state-of-the-art baselines.
format Online
Article
Text
id pubmed-7206263
institution National Center for Biotechnology Information
language English
publishDate 2020
record_format MEDLINE/PubMed
spelling pubmed-72062632020-05-08 Self-supervised Learning for Semi-supervised Time Series Classification Jawed, Shayan Grabocka, Josif Schmidt-Thieme, Lars Advances in Knowledge Discovery and Data Mining Article Self-supervised learning is a promising new technique for learning representative features in the absence of manual annotations. It is particularly efficient in cases where labeling the training data is expensive and tedious, naturally linking it to the semi-supervised learning paradigm. In this work, we propose a new semi-supervised time series classification model that leverages features learned from the self-supervised task on unlabeled data. The idea is to exploit the unlabeled training data with a forecasting task which provides a strong surrogate supervision signal for feature learning. We draw from established multi-task learning approaches and model forecasting as an auxiliary task to be optimized jointly with the main task of classification. We evaluate our proposed method on benchmark time series classification datasets in semi-supervised setting and are able to show that it significantly outperforms the state-of-the-art baselines. 2020-04-17 /pmc/articles/PMC7206263/ http://dx.doi.org/10.1007/978-3-030-47426-3_39 Text en © Springer Nature Switzerland AG 2020 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Jawed, Shayan
Grabocka, Josif
Schmidt-Thieme, Lars
Self-supervised Learning for Semi-supervised Time Series Classification
title Self-supervised Learning for Semi-supervised Time Series Classification
title_full Self-supervised Learning for Semi-supervised Time Series Classification
title_fullStr Self-supervised Learning for Semi-supervised Time Series Classification
title_full_unstemmed Self-supervised Learning for Semi-supervised Time Series Classification
title_short Self-supervised Learning for Semi-supervised Time Series Classification
title_sort self-supervised learning for semi-supervised time series classification
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7206263/
http://dx.doi.org/10.1007/978-3-030-47426-3_39
work_keys_str_mv AT jawedshayan selfsupervisedlearningforsemisupervisedtimeseriesclassification
AT grabockajosif selfsupervisedlearningforsemisupervisedtimeseriesclassification
AT schmidtthiemelars selfsupervisedlearningforsemisupervisedtimeseriesclassification