Yun He（贺赟)

• I am a Senior Research Scientist at Meta, Meta Superintelligence Labs (MSL).
• Email: heyunyun2014 'at' gmail.com
• Research Interests: LLM, RLHF, LLM post-training

Howdy! I am a senior research scientist at Meta (Meta Superintelligence Labs (MSL)), working on LLM post-training for Meta AI Assistant.

Previously, I was a member of the infolab led by Prof. James Caverlee in the Computer Science & Engineering Department at Texas A&M University. Before that, I was at the ICA lab in the School of Computer Science and Software Engineering at East China Normal University and worked with Dr. Qinmin Hu and Dr. Liang He. I obtained my Bachelor's degree from Donghua University.

Research Experience

Senior Research Scientist, Meta. (Aug 2023 – Present)

Research Project: LLM post-training for Meta AI assistant

Research Scientist, Meta. (July 2022 – July 2024)

Research Project: Recommender System

Research Intern, Google Brain. (September 2021 – December 2021)

Mentor: Dr. Huaixiu Zheng and Dr. Yi Tay
Research Project: A novel prompt-tuning method for transformer-based multi-task co-training

Research Intern, Facebook. (May 2021 – August 2021)

Mentor: Dr. Xinyi Zhang
Research Project: User history modeling for recommender system.

Research Intern, Facebook. (June 2020 – September 2020)

Mentor: Dr. Xue Feng
Research Project: Automatic balancing multiple training loss terms to improve multi-task learning-based recommender system.

Research Assistant, Texas A&M University (Fall 2017 – 2022)

Advisor: Dr. James Caverlee
Research Interests: Natural Language Processing and Recommender System

Selected Publications

See also my full publication list at Google Scholar profile.

• Rubric-Based Benchmarking and Reinforcement Learning for Advancing LLM Instruction Following [pdf]
  Arxiv, 2025
  Yun He*, Wenzhe Li*, Hejia Zhang*, Songlin Li*, etc.
  


• Dual-Weighted Reinforcement Learning for Generative Preference Modeling [pdf]
  Arxiv, 2025
  Shengyu Feng, Yun He (corresponding author), Shuang Ma, Beibin Li, etc.
  


• Multi-if: Benchmarking llms on multi-turn and multilingual instructions following [pdf]
  Arxiv, 2024
  Yun He*, Di Jin*, Chaoqi Wang*, Chloe Bi*, etc.
  


• PromptAttack: Probing Dialogue State Trackers with Adversarial Prompts [pdf]
  (ACL) (findings), 2023
  Xiangjue Dong, Yun He, Ziwei Zhu, James Caverlee
  


• HyperPrompt: Prompt-based Task-Conditioning of Transformers [pdf]
  International Conference on Machine Learning (ICML), 2022
  Yun He, Huaixiu Steven Zheng, Yi Tay, Jai Gupta, Yu Du, Vamsi Aribandi, Zhe Zhao, YaGuang Li, Zhao Chen, Donald Metzler, Heng-Tze Cheng and Ed H. Chi
  


• MetaBalance: Improving Multi-Task Recommendations via Adapting Gradient Magnitudes of Auxiliary Tasks [pdf] [code]
  The WebConference (WWW), 2022
  Yun He, Xue Feng, Cheng Cheng, Geng Ji, Yunsong Guo, James Caverlee
  


• Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition [pdf] [code]
  EMNLP 2020
  Yun He, Ziwei Zhu, Yin Zhang, Qin Chen and James Caverlee
  


• PARADE: A New Dataset for Paraphrase Identification Requiring Computer Science Domain Knowledge [pdf] [code]
  EMNLP 2020
  Yun He, Zhuoer Wang, Yin Zhang, Ruihong Huang and James Caverlee
  


• Consistency-Aware Recommendation for User-Generated Item Lists Continuation. [pdf] [code]
  International Conference on Web Search and Data Mining (WSDM 2020)
  Yun He, Yin Zhang, Weiwen Liu and James Caverlee


• A Hierarchical Self-Attentive Model for Recommending User-Generated Item Lists. [pdf] [code]
  International Conference on Information and Knowledge Management (CIKM 2019).
  Yun He, Jianling Wang, Wei Niu and James Caverlee


• Pseudo-Implicit Feedback for Alleviating Data Sparsity in Top-K Recommendation. (acceptance rate: 20%) [pdf] [code]
  IEEE International Conference on Data Mining (ICDM 2018).
  Yun He, Haochen Chen, Ziwei Zhu and James Caverlee.


• Estimating Probability Density of Content Types for Promoting Medical Records Search. (acceptance rate: 21%)
  European Conference on Information Retrieval (ECIR 2016).
  Yun He, Qinmin Hu, Yang Song and Liang He.


• ECNU at 2016 eHealth Task 1: Handover Information Extraction.（Working Notes) [pdf]
  Conference and Labs of the Evaluation Forum (CLEF 2016).
  Yang Song, Yun He, Hongyu Liu, Qinmin Hu, Liang He, Yueyao Wang.


• ECNU at 2016 eHealth Task 3: Patient-centred Information Retrieval. （Working Notes) [pdf]
  Conference and Labs of the Evaluation Forum (CLEF 2016).
  Yang Song, Yun He, Hongyu Liu, Yueyao Wang, Qinmin Hu, Liang He and Guihua Luo.


• ECNU at TREC 2016: Web-based query expansion and experts diagnosis in Medical Information Retrieval. (Working Notes) [pdf]
  Text Retrieval Conference (TREC 2016).
  Hongyu Liu, Yang Song, Yun He, Yueyao Wang, Qinmin Hu, Liang He.


• ECNU at 2015 CDS track: two re-ranking methods in medical information retrieval. (Working Notes) [pdf]
  Text Retrieval Conference (TREC 2015).
  1st place in Clinical Decision Support Track (Task B)
  Yang Song, Yun He, Qinmin Hu, Liang He.


• ECNU at 2015 eHealth Task 2: User-centred Health Information Retrieval. (Working Notes) [pdf]
  Conference and Labs of the Evaluation Forum (CLEF 2015).
  1st place in CLEF eHealth (Task2)
  Yang Song, Yun He, Qinmin Hu, Liang He, E Mark Haacke.


• ECNU at TREC 2014: Clinical decision support track. (Working Notes)
  Text Retrieval Conference (TREC 2014).
  Mingyao Li, Yang Song, Yun He, Qinmin Hu, Liang He, E Mark Haacke.

Teaching

• Teaching Assistant: CSCE 470 Information Storage and Retrieval, TAMU, Fall, 2017
• Teaching Assistant: CSCE 670 Information Storage and Retrieval, TAMU, Spring, 2020

Technical Talks

• Pseudo-Implicit Feedback for Alleviating Data Sparsity in Top-K Recommendation. ICDM, Singapore, 2018.
• Location-Sensitive User Profiling Using Crowdsourced Labels. AAAI, New Orleans, USA, 2018. (On behalf of Wei Niu, James Caverlee and Haokai Lu)
• Estimating Probability Density of Content Types for Promoting Medical Records Search. ECIR, Italy, 2016.

Professional Services

• External Reviewer: WWW'(18), WSDM 2020
• Reviewer for journals: SNAM2019; TKDE 2018, 2019; Neurocomputing 2021; IEEE Intelligent Systems 2021; Information Fusion 2022; Natural Language Engineering 2022
• Reviewer for conferences: ACL Demo Track 2020, 2021, 2022; EMNLP 2021, 2022; NAACL demo Track 2022; WSDM 2022; Neurips 2022; AAAI 2023;

Awards

• ECIR Student Travel Award, 2016
• National Scholarship for Graduate Student, 2016
• National Second Prize in China Graduate Mathematical Modeling Contest, 2014
• Honorable Mention in International Interdisciplinary Contest in Modeling, 2013
• National Second Prize in National College Mathematical Contest in Modeling

Personal

• Met my wife Jingwen Han in a badminton court at ECNU.
• A big fan of badminton, football and history.