Yun He (贺赟)
- Senior Research Scientist at Meta, Meta Superintelligence Labs (MSL)
- Email: heyunyun2014 'at' gmail.com
- Research Interests: LLM, RLHF, LLM post-training
Howdy! I am a senior research scientist at Meta (Meta Superintelligence Labs (MSL)), working on LLM post-training for Meta AI Assistant.
Previously, I was a member of the infolab led by Prof. James Caverlee in the Computer Science & Engineering Department at Texas A&M University. Before that, I was at the ICA lab in the School of Computer Science and Software Engineering at East China Normal University and worked with Dr. Qinmin Hu and Dr. Liang He. I obtained my Bachelor's degree from Donghua University.
Research Experience
Senior Research Scientist, Meta (Aug 2023 – Present)
Research Project: LLM post-training for Meta AI assistant
Research Scientist, Meta (July 2022 – July 2024)
Research Project: Recommender System
Research Intern, Google Brain (September 2021 – December 2021)
Mentor: Dr. Huaixiu Zheng and Dr. Yi Tay
Research Project: A novel prompt-tuning method for transformer-based multi-task co-training
Research Intern, Facebook (May 2021 – August 2021)
Mentor: Dr. Xinyi Zhang
Research Project: User history modeling for recommender system.
Research Intern, Facebook (June 2020 – September 2020)
Mentor: Dr. Xue Feng
Research Project: Automatic balancing multiple training loss terms to improve multi-task learning-based recommender system.
Research Assistant, Texas A&M University (Fall 2017 – 2022)
Advisor: Dr. James Caverlee
Research Interests: Natural Language Processing and Recommender System
Selected Publications
See also my full publication list at Google Scholar profile.
- Rubric-Based Benchmarking and Reinforcement Learning for Advancing LLM Instruction Following pdf
- Dual-Weighted Reinforcement Learning for Generative Preference Modeling pdf
- Multi-if: Benchmarking llms on multi-turn and multilingual instructions following pdf
- PromptAttack: Probing Dialogue State Trackers with Adversarial Prompts pdf
- HyperPrompt: Prompt-based Task-Conditioning of Transformers pdf
- MetaBalance: Improving Multi-Task Recommendations via Adapting Gradient Magnitudes of Auxiliary Tasks pdf code
- Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition pdf code
- PARADE: A New Dataset for Paraphrase Identification Requiring Computer Science Domain Knowledge pdf code
- Consistency-Aware Recommendation for User-Generated Item Lists Continuation pdf code
- A Hierarchical Self-Attentive Model for Recommending User-Generated Item Lists pdf code
- Pseudo-Implicit Feedback for Alleviating Data Sparsity in Top-K Recommendation (acceptance rate: 20%) pdf code
- Estimating Probability Density of Content Types for Promoting Medical Records Search (acceptance rate: 21%)
- ECNU at 2016 eHealth Task 1: Handover Information Extraction (Working Notes) pdf
- ECNU at 2016 eHealth Task 3: Patient-centred Information Retrieval (Working Notes) pdf
- ECNU at TREC 2016: Web-based query expansion and experts diagnosis in Medical Information Retrieval (Working Notes) pdf
-
ECNU at 2015 CDS track: two re-ranking methods in medical information retrieval (Working Notes)
1st place in Clinical Decision Support Track (Task B)pdf
-
ECNU at 2015 eHealth Task 2: User-centred Health Information Retrieval (Working Notes)
1st place in CLEF eHealth (Task2)pdf
- ECNU at TREC 2014: Clinical decision support track (Working Notes)
Teaching
- Teaching Assistant: CSCE 470 Information Storage and Retrieval, TAMU, Fall, 2017
- Teaching Assistant: CSCE 670 Information Storage and Retrieval, TAMU, Spring, 2020
Technical Talks
- Pseudo-Implicit Feedback for Alleviating Data Sparsity in Top-K Recommendation. ICDM, Singapore, 2018.
- Location-Sensitive User Profiling Using Crowdsourced Labels. AAAI, New Orleans, USA, 2018. (On behalf of Wei Niu, James Caverlee and Haokai Lu)
- Estimating Probability Density of Content Types for Promoting Medical Records Search. ECIR, Italy, 2016.
Professional Services
- External Reviewer: WWW'(18), WSDM 2020
- Reviewer for journals: SNAM2019; TKDE 2018, 2019; Neurocomputing 2021; IEEE Intelligent Systems 2021; Information Fusion 2022; Natural Language Engineering 2022
- Reviewer for conferences: ACL Demo Track 2020, 2021, 2022; EMNLP 2021, 2022; NAACL demo Track 2022; WSDM 2022; Neurips 2022; AAAI 2023;
Awards
- ECIR Student Travel Award, 2016
- National Scholarship for Graduate Student, 2016
- National Second Prize in China Graduate Mathematical Modeling Contest, 2014
- Honorable Mention in International Interdisciplinary Contest in Modeling, 2013
- National Second Prize in National College Mathematical Contest in Modeling
Personal
- Met my wife Jingwen Han in a badminton court at ECNU.
- A big fan of badminton, football and history.