Cargando…

Semantic enhanced for out-of-distribution detection

While improving the performance on the out-of-distribution (OOD) benchmark dataset, the existing approach misses a portion of the valid discriminative information such that it reduces the performance on the same manifold OOD (SMOOD) data. The key to addressing this problem is to prompt the model to...

Descripción completa

Detalles Bibliográficos
Autores principales: Jiang, Weijie, Yu, Yuanlong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9670166/
https://www.ncbi.nlm.nih.gov/pubmed/36406952
http://dx.doi.org/10.3389/fnbot.2022.1018383
_version_ 1784832281725108224
author Jiang, Weijie
Yu, Yuanlong
author_facet Jiang, Weijie
Yu, Yuanlong
author_sort Jiang, Weijie
collection PubMed
description While improving the performance on the out-of-distribution (OOD) benchmark dataset, the existing approach misses a portion of the valid discriminative information such that it reduces the performance on the same manifold OOD (SMOOD) data. The key to addressing this problem is to prompt the model to learn effective and comprehensive in-distribution (ID) semantic features. In this paper, two strategies are proposed to improve the generalization ability of the model to OOD data. Firstly, the original samples are replaced by features extracted from multiple “semantic perspectives” to obtain a comprehensive semantics of the samples; Second, the mean and variance of the batch samples are perturbed in the inference stage to improve the sensitivity of the model to the OOD data. The method we propose does not employ OOD samples, uses no pre-trained models in training, and does not require pre-processing of samples during inference. Experimental results show that our method enhances the semantic representation of ID data, surpasses state-of-the-art detection results on the OOD benchmark dataset, and significantly improves the performance of the model in detecting the SMOOD data.
format Online
Article
Text
id pubmed-9670166
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-96701662022-11-18 Semantic enhanced for out-of-distribution detection Jiang, Weijie Yu, Yuanlong Front Neurorobot Neuroscience While improving the performance on the out-of-distribution (OOD) benchmark dataset, the existing approach misses a portion of the valid discriminative information such that it reduces the performance on the same manifold OOD (SMOOD) data. The key to addressing this problem is to prompt the model to learn effective and comprehensive in-distribution (ID) semantic features. In this paper, two strategies are proposed to improve the generalization ability of the model to OOD data. Firstly, the original samples are replaced by features extracted from multiple “semantic perspectives” to obtain a comprehensive semantics of the samples; Second, the mean and variance of the batch samples are perturbed in the inference stage to improve the sensitivity of the model to the OOD data. The method we propose does not employ OOD samples, uses no pre-trained models in training, and does not require pre-processing of samples during inference. Experimental results show that our method enhances the semantic representation of ID data, surpasses state-of-the-art detection results on the OOD benchmark dataset, and significantly improves the performance of the model in detecting the SMOOD data. Frontiers Media S.A. 2022-11-03 /pmc/articles/PMC9670166/ /pubmed/36406952 http://dx.doi.org/10.3389/fnbot.2022.1018383 Text en Copyright © 2022 Jiang and Yu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Jiang, Weijie
Yu, Yuanlong
Semantic enhanced for out-of-distribution detection
title Semantic enhanced for out-of-distribution detection
title_full Semantic enhanced for out-of-distribution detection
title_fullStr Semantic enhanced for out-of-distribution detection
title_full_unstemmed Semantic enhanced for out-of-distribution detection
title_short Semantic enhanced for out-of-distribution detection
title_sort semantic enhanced for out-of-distribution detection
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9670166/
https://www.ncbi.nlm.nih.gov/pubmed/36406952
http://dx.doi.org/10.3389/fnbot.2022.1018383
work_keys_str_mv AT jiangweijie semanticenhancedforoutofdistributiondetection
AT yuyuanlong semanticenhancedforoutofdistributiondetection