fajieyuan / Recommendation-Systems-without-Explicit-ID-Features-A-Literature-Review

Large pre-trained Foundation recommender models

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Foundation models for Recommender System Paper List

Welcome to open an issue or make a pull request!

Keyword: Recommend System, pretraining, large language model, multimodal recommender system, transferable recommender system, foundation recommender models, ID features, ID embeddings

These papers attempt to address the following questions:

(1) Can recommender systems have their own foundation models similar to those used in NLP and CV?

(2) Is ID embedding necessary for recommender models, can we replace or abondon it?

(3) Will recommender systems shift from a matching paradigm to a generating paradigm?

(4) How can LLM be utilized to enhance recommender systems?

(5) What does the future hold for multimodal recommender systems?

Paper List

Perspective Paper (ID vs LLM & Multimodal)

  • Where to Go Next for Recommender Systems? ID-vs. Modality-based recommender models revisited, SIGIR2023, 2022/09, [paper] [code]
  • Exploring the Upper Limits of Text-Based Collaborative Filtering Using Large Language Models: Discoveries and Insights, arxiv 2023/05, [paper]

Survey

  • How Can Recommender Systems Benefit from Large Language Models: A Survey, arxiv 2023/06, [paper]
  • Recommender Systems in the Era of Large Language Models, arxiv, 2023/07, [paper]
  • A Survey on Large Language Models for Recommendation, arxiv 2023/05, [paper]

Large Language Models for Recommendation (LLM4Rec)

Tuning LLM

  • M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systems,arxiv 2022/05, [paper]
  • Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5), Recsys 2022/05, [paper])
  • PTab: Using the Pre-trained Language Model for Modeling Tabular Data, arxiv 2022/09, [paper]
  • TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation, arxiv 2023/04, [paper]
  • GPT4Rec: A Generative Framework for Personalized Recommendation and User Interests Interpretation, 2023/04, [paper]

Freezing LLM [link]

  • CTR-BERT: Cost-effective knowledge distillation for billion-parameter teacher models,arxiv 2022/04, [paper]
  • Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning, arxiv 2022/06, [paper]
  • Generative Recommendation: Towards Next-generation Recommender Paradigm, arxiv 2023/04, [paper]
  • A First Look at LLM-Powered Generative News Recommendation, arxiv 2023/05, [paper]
  • Privacy-Preserving Recommender Systems with Synthetic Query Generation using Differentially Private Large Language Models, arxiv 2023/05,[paper]
  • RecAgent: A Novel Simulation Paradigm for Recommender Systems, arxiv 2023/06, [paper]
  • Zero-Shot Next-Item Recommendation using Large Pretrained Language Models, arxiv 2023/04, [paper]
  • Can ChatGPT Make Fair Recommendation? A Fairness Evaluation Benchmark for Recommendation with Large Language Model, RecSys 2023

Prompt with LLM

  • Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5), RecSys 2022, [paper]
  • Language Models as Recommender Systems: Evaluations and Limitations, NeurIPS Workshop ICBINB 2021/10, [paper]
  • Prompt Learning for News Recommendation, SIGIR 2023/04, [paper]

ChatGPT [link]

  • Is ChatGPT a Good Recommender A Preliminary Study, arxiv 2023/04, [paper]
  • Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agent, arxiv 2023/04, [paper]
  • Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender System, arxiv 2023/04,[paper]
  • Large Language Models are Zero-Shot Rankers for Recommender Systems, arxiv 2023/05, [paper]
  • Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach, arxiv 2023/05, [paper]
  • Leveraging Large Language Models in Conversational Recommender Systems, arxiv 2023/05, [paper]
  • Uncovering ChatGPT’s Capabilities in Recommender Systems, arxiv 2023/05, [paper][code]
  • Sparks of Artificial General Recommender (AGR): Early Experiments with ChatGPT, arxiv 2023/05, [paper]
  • Is ChatGPT Fair for Recommendation? Evaluating Fairness in Large Language Model Recommendation, arxiv 2023/05,[paper] [code]
  • Sparks of Artificial General Recommender (AGR): Early Experiments with ChatGPT, arxiv 2023/05,[paper]
  • PALR: Personalization Aware LLMs for Recommendation, arxiv 2023/05, [paper]
  • Privacy-Preserving Recommender Systems with Synthetic Query Generation using Differentially Private Large Language Models, arxiv 2023/05, [paper]
  • Rethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models, arxiv 2023/05, [paper]
  • CTRL: Connect Tabular and Language Model for CTR Prediction, arxiv 2023/06,[paper]

Multimodal Recommender System

  • VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback, AAAI2016, [paper]
  • Multi-modal Knowledge Graphs for Recommender Systems, CIKM 2020, [paper]

Foundation and Transferable Recommender models

  • TransRec: Learning Transferable Recommendation from Mixture-of-Modality Feedback, arxiv 2022/06, [paper]
  • Towards Universal Sequence Representation Learning for Recommender Systems, KDD2022,2022/06, [paper]
  • Learning Vector-Quantized Item Representation for Transferable Sequential Recommenders, WWW 2023, [paper] [code]
  • Exploring Adapter-based Transfer Learning for Recommender Systems: Empirical Studies and Practical Insights, arxiv 2023, [paper]
  • UP5: Unbiased Foundation Model for Fairness-aware Recommendation, arxiv 2023/05, [paper]
  • VIP5: Towards Multimodal Foundation Models for Recommendation, arxiv 2023/05, [paper]
  • OpenP5: Benchmarking Foundation Models for Recommendation, arxiv 2023/06, [paper]

Universal One4all Representation Learning

  • Parameter-Efficient Transfer from Sequential Behaviors for User Modeling and Recommendation, SIGIR 2020, [paper], [code]
  • U-BERT: Pre-training user representations for improved recommendation, AAAI 2021, [paper]
  • One4all User Representation for Recommender Systems in E-commerce, arxiv 2021, [paper]
  • Learning Transferable User Representations with Sequential Behaviors via Contrastive Pre-training, ICDM 2021, [paper]
  • Scaling Law for Recommendation Models: Towards General-purpose User Representations, AAAI 2023, [paper]

Lifelong User Representation Learning

  • One Person, One Model, One World: Learning Continual User Representation without Forgetting, SIGIR 2021, [paper], [code]
  • Tenrec: A Large-scale Multipurpose Benchmark Dataset for Recommender Systems, NeurIPS 2022 [paper]
  • STAN: Stage-Adaptive Network for Multi-Task Recommendation by Learning User Lifecycle-Based Representationg, Recsys 2023, [paper]
  • Task Relation-aware Continual User Representation Learning, KDD2023, [paper]

Generative Recommender Systems [link]

  • A Simple Convolutional Generative Network for Next Item Recommendation, WSDM 2018/08, [paper] [code]
  • Future Data Helps Training: Modeling Future Contexts for Session-based Recommendation, WWW 2020/04, [paper] [code]
  • Recommendation via Collaborative Diffusion Generative Model, KSEM 2022/08, [paper]
  • Blurring-Sharpening Process Models for Collaborative Filtering, arxiv 2022/09, [paper]
  • Generative Slate Recommendation with Reinforcement Learning, arxiv 2023/01, [paper]
  • Recommender Systems with Generative Retrieval, arxiv 2023/04, [paper]
  • DiffuRec: A Diffusion Model for Sequential Recommendation, arxiv 2023/04, [paper]
  • Diffusion Recommender Model, arxiv 2023/04, [paper]
  • A First Look at LLM-Powered Generative News Recommendation, arxiv 2023/05, [paper]
  • Recommender Systems with Generative Retrieval, arxiv 2023/05, [paper]
  • Generative Retrieval as Dense Retrieval, arxiv 2023/06, [paper]
  • RecFusion: A Binomial Diffusion Process for 1D Data for Recommendation, arxiv 2023/06, [paper]
  • Generative Sequential Recommendation with GPTRec, SIGIR workshop 2023, [paper]
  • FANS: Fast Non-Autoregressive Sequence Generation for Item List Continuation, WWW 2023, [paper]
  • Generative Next-Basket Recommendation, RecSys 2023
  • Large Language Model Augmented Narrative Driven Recommendations, RecSys 2023, [paper]

Dataset

  • PeterRec dataset[link]
  • Tenrec: A Large-scale Multipurpose Benchmark Dataset for Recommender Systems, NeurIPS 2022 [paper]
  • Where to Go Next for Recommender Systems? ID-vs. Modality-based recommender models revisited, openreview 2022/09, [paper]

Reference:

About

Large pre-trained Foundation recommender models