Cargando…
Semantic enhanced for out-of-distribution detection
While improving the performance on the out-of-distribution (OOD) benchmark dataset, the existing approach misses a portion of the valid discriminative information such that it reduces the performance on the same manifold OOD (SMOOD) data. The key to addressing this problem is to prompt the model to...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9670166/ https://www.ncbi.nlm.nih.gov/pubmed/36406952 http://dx.doi.org/10.3389/fnbot.2022.1018383 |
_version_ | 1784832281725108224 |
---|---|
author | Jiang, Weijie Yu, Yuanlong |
author_facet | Jiang, Weijie Yu, Yuanlong |
author_sort | Jiang, Weijie |
collection | PubMed |
description | While improving the performance on the out-of-distribution (OOD) benchmark dataset, the existing approach misses a portion of the valid discriminative information such that it reduces the performance on the same manifold OOD (SMOOD) data. The key to addressing this problem is to prompt the model to learn effective and comprehensive in-distribution (ID) semantic features. In this paper, two strategies are proposed to improve the generalization ability of the model to OOD data. Firstly, the original samples are replaced by features extracted from multiple “semantic perspectives” to obtain a comprehensive semantics of the samples; Second, the mean and variance of the batch samples are perturbed in the inference stage to improve the sensitivity of the model to the OOD data. The method we propose does not employ OOD samples, uses no pre-trained models in training, and does not require pre-processing of samples during inference. Experimental results show that our method enhances the semantic representation of ID data, surpasses state-of-the-art detection results on the OOD benchmark dataset, and significantly improves the performance of the model in detecting the SMOOD data. |
format | Online Article Text |
id | pubmed-9670166 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-96701662022-11-18 Semantic enhanced for out-of-distribution detection Jiang, Weijie Yu, Yuanlong Front Neurorobot Neuroscience While improving the performance on the out-of-distribution (OOD) benchmark dataset, the existing approach misses a portion of the valid discriminative information such that it reduces the performance on the same manifold OOD (SMOOD) data. The key to addressing this problem is to prompt the model to learn effective and comprehensive in-distribution (ID) semantic features. In this paper, two strategies are proposed to improve the generalization ability of the model to OOD data. Firstly, the original samples are replaced by features extracted from multiple “semantic perspectives” to obtain a comprehensive semantics of the samples; Second, the mean and variance of the batch samples are perturbed in the inference stage to improve the sensitivity of the model to the OOD data. The method we propose does not employ OOD samples, uses no pre-trained models in training, and does not require pre-processing of samples during inference. Experimental results show that our method enhances the semantic representation of ID data, surpasses state-of-the-art detection results on the OOD benchmark dataset, and significantly improves the performance of the model in detecting the SMOOD data. Frontiers Media S.A. 2022-11-03 /pmc/articles/PMC9670166/ /pubmed/36406952 http://dx.doi.org/10.3389/fnbot.2022.1018383 Text en Copyright © 2022 Jiang and Yu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Jiang, Weijie Yu, Yuanlong Semantic enhanced for out-of-distribution detection |
title | Semantic enhanced for out-of-distribution detection |
title_full | Semantic enhanced for out-of-distribution detection |
title_fullStr | Semantic enhanced for out-of-distribution detection |
title_full_unstemmed | Semantic enhanced for out-of-distribution detection |
title_short | Semantic enhanced for out-of-distribution detection |
title_sort | semantic enhanced for out-of-distribution detection |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9670166/ https://www.ncbi.nlm.nih.gov/pubmed/36406952 http://dx.doi.org/10.3389/fnbot.2022.1018383 |
work_keys_str_mv | AT jiangweijie semanticenhancedforoutofdistributiondetection AT yuyuanlong semanticenhancedforoutofdistributiondetection |