Self-supervised graph learning with target-adaptive masking for session-based recommendation

Yitong WANG; Fei CAI; Zhiqiang PAN; Chengyu SONG

doi:10.1631/FITEE.2200137

Your Location：

Home >

Browse articles >

Self-supervised graph learning with target-adaptive masking for session-based recommendation

Regular Papers | Updated：2023-01-28

- Self-supervised graph learning with target-adaptive masking for session-based recommendation
- 融合自监督图学习与目标自适应屏蔽的会话型推荐方法
- Frontiers of Information Technology & Electronic Engineering Vol. 24, Issue 1, Pages: 73-87(2023)
- Affiliations：
  
  Science and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410073, China
- Author bio：
  
  E-mail: wangyitong20@nudt.edu.cn;
  ‡Corresponding authors
  panzhiqiang@nudt.edu.cn;
  songchengyu@nudt.edu.cn
- Funds：
- DOI：10.1631/FITEE.2200137
  CLC： TP391
- Received：07 April 2022，
  
  Accepted：02 August 2022，
  
  Published：0 January 2023
- Accepted：
Scan QR Code
Yitong WANG, Fei CAI, Zhiqiang PAN, et al. Self-supervised graph learning with target-adaptive masking for session-based recommendation[J]. Frontiers of Information Technology & Electronic Engineering, 2023, 24(1): 73-87.
DOI：

Yitong WANG, Fei CAI, Zhiqiang PAN, et al. Self-supervised graph learning with target-adaptive masking for session-based recommendation[J]. Frontiers of Information Technology & Electronic Engineering, 2023, 24(1): 73-87. DOI： 10.1631/FITEE.2200137.

摘要

会话型推荐旨在根据用户在短时间内有限的交互来预测下一个时间戳将要进行交互的物品。现有模型主要使用循环神经网络（RNN）或图神经网络（GNN）来建模顺序序列或物品之间的传递关系。然而，此类模型要么忽略了GNN的过度平滑问题，要么直接利用交叉熵损失和softmax层进行模型优化，容易导致过拟合问题。为了解决上述问题，本文提出一种融合自监督图学习与目标自适应屏蔽的会话型推荐方法（SGL-TM）。具体来说，首先根据所有涉及到的会话构建全局图，然后从物品之间的全局连接中捕捉自监督信号，用来监督模型生成当前会话中准确的物品表示。之后，通过比较真值与经过我们设计的目标自适应屏蔽模块调整后的物品的预测分数来计算主监督损失。最后，将主监督组件与辅助自监督模块相结合，以获得用来优化模型参数的最终损失。在两个真实数据集（Gowalla和Diginetica）上的大量实验结果表明，SGL-TM在Recall@20和MRR@20方面的性能优于最先进的基准模型，尤其体现在短会话上。

Abstract

Session-based recommendation aims to predict the next item based on a user's limited interactions within a short period. Existing approaches use mainly recurrent neural networks (RNNs) or graph neural networks (GNNs) to model the sequential patterns or the transition relationships between items. However

such models either ignore the over-smoothing issue of GNNs

or directly use cross-entropy loss with a softmax layer for model optimization

which easily results in the over-fitting problem. To tackle the above issues

we propose a self-supervised graph learning with target-adaptive masking (SGL-TM) method. Specifically

we first construct a global graph based on all involved sessions and subsequently capture the self-supervised signals from the global connections between items

which helps supervise the model in generating accurate representations of items in the ongoing session. After that

we calculate the main supervised loss by comparing the ground truth with the predicted scores of items adjusted by our designed target-adaptive masking module. Finally

we combine the main supervised component with the auxiliary self-supervision module to obtain the final loss for optimizing the model parameters. Extensive experimental results from two benchmark datasets

Gowalla and Diginetica

indicate that SGL-TM can outperform state-of-the-art baselines in terms of Recall@20 and MRR@20

especially in short sessions.

关键词

Keywords

references

Afouras T , Owens A , Chung JS , et al. , 2020 . Self-supervised learning of audio-visual objects from video . Proc 16 th European Conf , p. 208 - 224 . doi: 10.1007/978-3-030-58523-5_13 http://doi.org/10.1007/978-3-030-58523-5_13

Chen M , Wei ZW , Huang ZF , et al. , 2020 . Simple and deep graph convolutional networks . Proc 37 th Int Conf on Machine Learning , p. 1725 - 1735 . doi: 10.5555/3524938.3525099 http://doi.org/10.5555/3524938.3525099

Chen T , Kornblith S , Norouzi M , et al. , 2020 . A simple framework for contrastive learning of visual representations . Proc 37 th Int Conf on Machine Learning , p. 1597 - 1607 . doi: 10.5555/3524938.3525087 http://doi.org/10.5555/3524938.3525087

Chen TW , Wong RCW , 2020 . Handling information loss of graph neural networks for session-based recommendation . Proc 26 th ACM SIGKDD Int Conf on Knowledge Discovery & Data Mining , p. 1172 - 1180 . doi: 10.1145/3394486.3403170 http://doi.org/10.1145/3394486.3403170

Cheng ZY , Shen JL , Zhu L , et al. , 2017 . Exploiting music play sequence for music recommendation . Proc 26 th Int Joint Conf on Artificial Intelligence , p. 3654 - 3660 . doi: 10.24963/ijcai.2017/511 http://doi.org/10.24963/ijcai.2017/511

Choi M , Kim J , Lee J , et al. , 2021 . Session-aware linear item–item models for session-based recommendation . Proc Web Conf , p. 2186 - 2197 . doi: 10.1145/3442381.3450005 http://doi.org/10.1145/3442381.3450005

Davidson J , Liebald B , Liu JN , et al. , 2010 . The YouTube video recommendation system . Proc 4 th ACM Conf on Recommender Systems , p. 293 - 296 . doi: 10.1145/1864708.1864770 http://doi.org/10.1145/1864708.1864770

Hidasi B , Karatzoglou A , Baltrunas L , et al. , 2016 . Session-based recommendations with recurrent neural networks . Proc 4 th Int Conf on Learning Representations .

Hjelm RD , Fedorov A , Lavoie-Marchildon S , et al. , 2019 . Learning deep representations by mutual information estimation and maximization . Proc 7 th Int Conf on Learning Representations .

Kingma DP , Ba LJ , 2015 . Adam: a method for stochastic optimization . Proc 3 rd Int Conf on Learning Representations .

Kipf TN , Welling M , 2017 . Semi-supervised classification with graph convolutional networks . Proc 5 th Int Conf on Learning Representations .

Kong LP , de Masson d’Autume C , Yu L , et al. , 2020 . A mutual information maximization perspective of language representation learning . Proc 8 th Int Conf on Learning Representations .

Li J , Ren PJ , Chen ZM , et al. , 2017 . Neural attentive session-based recommendation . Proc ACM Conf on Information and Knowledge Management , p. 1419 - 1428 . doi: 10.1145/3132847.3132926 http://doi.org/10.1145/3132847.3132926

Li YJ , Tarlow D , Brockschmidt M , et al. , 2016 . Gated graph sequence neural networks . Proc 4 th Int Conf on Learning Representations .

Liu Q , Zeng YF , Mokhosi R , et al. , 2018 . STAMP: short-term attention/memory priority model for session-based recommendation . Proc 24 th ACM SIGKDD Int Conf on Knowledge Discovery & Data Mining , p. 1831 - 1839 . doi: 10.1145/3219819.3219950 http://doi.org/10.1145/3219819.3219950

Nie LQ , Li YQ , Feng FL , et al. , 2020 . Large-scale question tagging via joint question-topic embedding learning . ACM Trans Inform Syst , 38 ( 2 ): 20 . doi: 10.1145/3380954 http://doi.org/10.1145/3380954

Nie LQ , Jiao FK , Wang WJ , et al. , 2021 . Conversational image search . IEEE Trans Image Process , 30 : 7732 - 7743 . doi: 10.1109/TIP.2021.3108724 http://doi.org/10.1109/TIP.2021.3108724

Pan ZQ , Cai F , Chen WY , et al. , 2020 . Star graph neural networks for session-based recommendation . Proc 29 th ACM Int Conf on Information & Knowledge Management , p. 1195 - 1204 . doi: 10.1145/3340531.3412014 http://doi.org/10.1145/3340531.3412014

Pan ZQ , Cai F , Chen WY , et al. , 2022 . Graph co-attentive session-based recommendation . ACM Trans Inform Syst , 40 ( 4 ): 67 . doi: 10.1145/3486711 http://doi.org/10.1145/3486711

Qiu RH , Li JJ , Huang Z , et al. , 2019 . Rethinking the item order in session-based recommendation with graph neural networks . Proc 28 th ACM Int Conf on Information and Knowledge Management , p. 579 - 588 . doi: 10.1145/3357384.3358010 http://doi.org/10.1145/3357384.3358010

Qiu RH , Huang Z , Li JJ , et al. , 2020 . Exploiting cross-session information for session-based recommendation with graph neural networks . ACM Trans Inform Syst , 38 ( 3 ): 22 . doi: 10.1145/3382764 http://doi.org/10.1145/3382764

Rendle S , Freudenthaler C , Schmidt-Thieme L , 2010 . Factorizing personalized Markov chains for next-basket recommendation . Proc 19 th Int Conf on World Wide Web , p. 811 - 820 . doi: 10.1145/1772690.1772773 http://doi.org/10.1145/1772690.1772773

Rumelhart DE , Hinton GE , Williams RJ , 1986 . Learning representations by back-propagating errors . Nature , 323 ( 6088 ): 533 - 536 . doi: 10.1038/323533a0 http://doi.org/10.1038/323533a0

Shani G , Heckerman D , Brafman RI , 2005 . An MDP-based recommender system . J Mach Learn Res , 6 : 1265 - 1295 .

Singhal A , Sinha P , Pant R , 2017 . Use of deep learning in modern recommendation system: a summary of recent works . Int J Comput Appl , 180 ( 7 ): 17 - 22 .

Tan YK , Xu XX , Liu Y , 2016 . Improved recurrent neural networks for session-based recommendations . Proc 1 st Workshop on Deep Learning for Recommender Systems , p. 17 - 22 . doi: 10.1145/2988450.2988452 http://doi.org/10.1145/2988450.2988452

Tang JX , Wang K , 2018 . Personalized top- n sequential recommendation via convolutional sequence embedding . Proc 11 th ACM Int Conf on Web Search and Data Mining , p. 565 - 573 . doi: 10.1145/3159652.3159656 http://doi.org/10.1145/3159652.3159656

Veličković P , Cucurull G , Casanova A , et al. , 2018 . Graph attention networks . Proc 6 th Int Conf on Learning Representations .

Wang SJ , Cao LB , Wang Y , et al. , 2022 . A survey on session-based recommender systems . ACM Comput Surv , 54 ( 7 ): 154 . doi: 10.1145/3465401 http://doi.org/10.1145/3465401

Wang X , He XN , Wang M , et al. , 2019 . Neural graph collaborative filtering . Proc 42 nd Int ACM SIGIR Conf on Research and Development in Information Retrieval , p. 165 - 174 . doi: 10.1145/3331184.3331267 http://doi.org/10.1145/3331184.3331267

Wang XN , Tan QM , 2020 . DAN: a deep association neural network approach for personalization recommendation . Front Inform Technol Electron Eng , 21 ( 7 ): 963 - 980 . doi: 10.1631/FITEE.1900236 http://doi.org/10.1631/FITEE.1900236

Wang ZY , Wei W , Cong G , et al. , 2020 . Global context enhanced graph neural networks for session-based recommendation . Proc 43 rd Int ACM SIGIR Conf on Research and Development in Information Retrieval , p. 169 - 178 . doi: 10.1145/3397271.3401142 http://doi.org/10.1145/3397271.3401142

Wu S , Tang YY , Zhu YQ , et al. , 2019 . Session-based recommendation with graph neural networks . Proc 33 rd AAAI Conf on Artificial Intelligence , p. 346 - 353 . doi: 10.1609/aaai.v33i01.3301346 http://doi.org/10.1609/aaai.v33i01.3301346

Xia X , Yin HZ , Yu JL , et al. , 2021a . Self-supervised graph co-training for session-based recommendation . Proc 30 th ACM Int Conf on Information & Knowledge Management , p. 2180 - 2190 . doi: 10.1145/3459637.3482388 http://doi.org/10.1145/3459637.3482388

Xia X , Yin HZ , Yu JL , et al. , 2021b . Self-supervised hyper- graph convolutional networks for session-based recommendation . Proc 35 th AAAI Conf on Artificial Intelligence , p. 4503 - 4511 .

Xie X , Sun F , Liu ZY , et al. , 2022 . Contrastive learning for sequential recommendation . Proc IEEE 38 th Int Conf on Data Engineering , p. 1259 - 1273 . doi: 10.1109/ICDE53745.2022.00099 http://doi.org/10.1109/ICDE53745.2022.00099

Xin X , Karatzoglou A , Arapakis I , et al. , 2020 . Self-supervised reinforcement learning for recommender systems . Proc 43 rd Int ACM SIGIR Conf on Research and Development in Information Retrieval , p. 931 - 940 . doi: 10.1145/3397271.3401147 http://doi.org/10.1145/3397271.3401147

Xu CF , Zhao PP , Liu YC , et al. , 2019 . Graph contextualized self-attention network for session-based recommendation . Proc 28 th Int Joint Conf on Artificial Intelligence , p. 3940 - 3946 . doi: 10.24963/ijcai.2019/547 http://doi.org/10.24963/ijcai.2019/547

Yao TS , Yi XY , Cheng DZ , et al. , 2021 . Self-supervised learning for large-scale item recommendations . Proc 30 th ACM Int Conf on Information & Knowledge Management , p. 4321 - 4330 . doi: 10.1145/3459637.3481952 http://doi.org/10.1145/3459637.3481952

Yuan FJ , Karatzoglou A , Arapakis I , et al. , 2019 . A simple convolutional generative network for next item recommendation . Proc 12 th ACM Int Conf on Web Search and Data Mining , p. 582 - 590 . doi: 10.1145/3289600.3290975 http://doi.org/10.1145/3289600.3290975

Zhang JQ , Zhao Y , Saleh M , et al. , 2020 . PEGASUS: pre-training with extracted gap-sentences for abstractive summarization . Proc 37 th Int Conf on Machine Learning , p. 11328 - 11339 . doi: 10.5555/3524938.3525989 http://doi.org/10.5555/3524938.3525989

Zheng JW , Ma QL , Gu H , et al. , 2021 . Multi-view denoising graph auto-encoders on heterogeneous information networks for cold-start recommendation . Proc 27 th ACM SIGKDD Conf on Knowledge Discovery & Data Mining , p. 2338 - 2348 . doi: 10.1145/3447548.3467427 http://doi.org/10.1145/3447548.3467427

Zhou K , Wang H , Zhao WX , et al. , 2020 . S 3 -Rec: self-supervised learning for sequential recommendation with mutual information maximization . Proc 29 th ACM Int Conf on Information & Knowledge Management , p. 1893 - 1902 . doi: 10.1145/3340531.3411954 http://doi.org/10.1145/3340531.3411954

Views

143

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

E-CGL: an efficient continual graph learner

Towards adaptive graph neural networks via solving prior-data conflicts

A self-supervised method for treatment recommendation in sepsis

Related Author

Jianhao GUO

Zixuan NI

Yun ZHU

Siliang TANG

Xugang WU

Huijun WU

Ruibo WANG

Xu ZHOU

Related Institution

Digital Media Computing & Design Lab, College of Computer Science and Technology, Zhejiang University

College of Computer, National University of Defense Technology

School of Computer Science and Technology, East China Normal University

Institute of Science and Technology for Brain-inspired Intelligence, Fudan University

College of Computer, National University of Defense Technology

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰