Cargando…

GAIN: A Gated Adaptive Feature Interaction Network for Click-Through Rate Prediction

CTR (Click-Through Rate) prediction has attracted more and more attention from academia and industry for its significant contribution to revenue. In the last decade, learning feature interactions have become a mainstream research direction, and dozens of feature interaction-based models have been pr...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Yaoxun, Ma, Liangli, Wang, Muyuan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9571864/
https://www.ncbi.nlm.nih.gov/pubmed/36236377
http://dx.doi.org/10.3390/s22197280
_version_ 1784810470181437440
author Liu, Yaoxun
Ma, Liangli
Wang, Muyuan
author_facet Liu, Yaoxun
Ma, Liangli
Wang, Muyuan
author_sort Liu, Yaoxun
collection PubMed
description CTR (Click-Through Rate) prediction has attracted more and more attention from academia and industry for its significant contribution to revenue. In the last decade, learning feature interactions have become a mainstream research direction, and dozens of feature interaction-based models have been proposed for the CTR prediction task. The most common approach for existing models is to enumerate all possible feature interactions or to learn higher-order feature interactions by designing complex models. However, a simple enumeration will introduce meaningless and harmful interactions, and a complex model structure will bring a higher complexity. In this work, we propose a lightweight, yet effective model called the Gated Adaptive feature Interaction Network (GAIN). We devise a novel cross module to drop meaningless feature interactions and preserve informative ones. Our cross module consists of multiple gated units, each of which can independently learn an arbitrary-order feature interaction. We combine the cross module with a deep module into GAIN and conduct comparative experiments with state-of-the-art models on two public datasets to verify its validity. Our experimental results show that GAIN can achieve a comparable or even better performance compared to its competitors. Furthermore, in order to verify the effectiveness of the feature interactions learned by GAIN, we transfer learned interactions to other models, such as Logistic Regression (LR) and Factorization Machines (FM), and find out that their performance can be significantly improved.
format Online
Article
Text
id pubmed-9571864
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-95718642022-10-17 GAIN: A Gated Adaptive Feature Interaction Network for Click-Through Rate Prediction Liu, Yaoxun Ma, Liangli Wang, Muyuan Sensors (Basel) Article CTR (Click-Through Rate) prediction has attracted more and more attention from academia and industry for its significant contribution to revenue. In the last decade, learning feature interactions have become a mainstream research direction, and dozens of feature interaction-based models have been proposed for the CTR prediction task. The most common approach for existing models is to enumerate all possible feature interactions or to learn higher-order feature interactions by designing complex models. However, a simple enumeration will introduce meaningless and harmful interactions, and a complex model structure will bring a higher complexity. In this work, we propose a lightweight, yet effective model called the Gated Adaptive feature Interaction Network (GAIN). We devise a novel cross module to drop meaningless feature interactions and preserve informative ones. Our cross module consists of multiple gated units, each of which can independently learn an arbitrary-order feature interaction. We combine the cross module with a deep module into GAIN and conduct comparative experiments with state-of-the-art models on two public datasets to verify its validity. Our experimental results show that GAIN can achieve a comparable or even better performance compared to its competitors. Furthermore, in order to verify the effectiveness of the feature interactions learned by GAIN, we transfer learned interactions to other models, such as Logistic Regression (LR) and Factorization Machines (FM), and find out that their performance can be significantly improved. MDPI 2022-09-26 /pmc/articles/PMC9571864/ /pubmed/36236377 http://dx.doi.org/10.3390/s22197280 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Liu, Yaoxun
Ma, Liangli
Wang, Muyuan
GAIN: A Gated Adaptive Feature Interaction Network for Click-Through Rate Prediction
title GAIN: A Gated Adaptive Feature Interaction Network for Click-Through Rate Prediction
title_full GAIN: A Gated Adaptive Feature Interaction Network for Click-Through Rate Prediction
title_fullStr GAIN: A Gated Adaptive Feature Interaction Network for Click-Through Rate Prediction
title_full_unstemmed GAIN: A Gated Adaptive Feature Interaction Network for Click-Through Rate Prediction
title_short GAIN: A Gated Adaptive Feature Interaction Network for Click-Through Rate Prediction
title_sort gain: a gated adaptive feature interaction network for click-through rate prediction
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9571864/
https://www.ncbi.nlm.nih.gov/pubmed/36236377
http://dx.doi.org/10.3390/s22197280
work_keys_str_mv AT liuyaoxun gainagatedadaptivefeatureinteractionnetworkforclickthroughrateprediction
AT maliangli gainagatedadaptivefeatureinteractionnetworkforclickthroughrateprediction
AT wangmuyuan gainagatedadaptivefeatureinteractionnetworkforclickthroughrateprediction