I am a second year CS PhD at UC Santa Barbara, advised by William Wang at Natural Language Processing Group. I closely collaborate with Miguel Eckstein at Vision and Image Understanding Lab. I obtained my bachelor’s degree from Chu Kochen Honors College, Zhejiang University, advised by Deng Cai and Mingli Song .

My current research focuses on Vision and Language. More specifically, I work on language grounding in vision/action, language-conditioned planning, and embodied agent.


ULN: Towards Underspecified Vision-and-Language Navigation

Weixi Feng, Tsu-Jui Fu, Yujie Lu, William Yang Wang

The Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022

Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error Synthesis

Wenda Xu, Yi-Lin Tuan, Yujie Lu, Michael S. Saxon, Lei Li, William Yang Wang

The Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022

MIC: Model-agnostic Integrated Cross-channel Recommenders

Yujie Lu*, Ping Nie*, Shengyu Zhang, Ming Zhao, Ruobing Xie, William Yang Wang, Yi Ren

The Conference on Information and Knowledge Management (CIKM), Oral Presentation, 2022 (* indicates equal contribution)

Imagination-Augmented Natural Language Understanding

Yujie Lu, Wanrong Zhu, Xin Eric Wang, Miguel Eckstein, William Yang Wang,

North American Chapter of the Association for Computational Linguistics (NAACL), Oral Presentation, 2022

Re4: Learning to Re-contrast, Re-attend, Re-construct for Multi-interest Recommendation

Shengyu Zhang, Lingxiao Yang, Dong Yao, Yujie Lu, Fuli Feng, Zhou Zhao, Tat-Seng Chua, Fei Wu

The Web Conference (WWW), 2022

Future-Aware Diverse Trends Framework for Recommendation

Yujie Lu, Shengyu Zhang, Yingxuan Huang, Luyao Wang, Xinyao Yu, Zhou Zhao, Fei Wu

The Web Conference (WWW), 2021

CLOUD: Contrastive Learning of Unsupervised Dynamics

Yujie Lu*, Jianren Wang*, Hang Zhao

The Conference on Robot Learning (CoRL), 2020 (* indicates equal contribution)


Neuro-Symbolic Causal Language Planning with Commonsense Prompting

Yujie Lu, Weixi Feng, Wanrong Zhu, Wenda Xu, Xin Eric Wang, Miguel Eckstein, William Yang Wang

Visualize Before You Write: Imagination-Guided Open-Ended Text Generation

Wanrong Zhu, An Yan, Yujie Lu, Wenda Xu, Xin Eric Wang, Miguel Eckstein, William Yang Wang

LAD: Language Augmented Diffusion for Reinforcement Learning

Edwin Zhang, Yujie Lu, William Yang Wang, Amy Zhang

Curiosity Driven Self-supervised Tactile Exploration of Unknown Objects

Yujie Lu*, Jianren Wang*, Vikash Kumar


  • 2022, Research Intern, Microsoft Research
    Advisor: Oriana Riva
  • 2019-2021, Applied Researcher, Tencent
  • 2019, Research Assistant, Digital Media Computing & Design Lab, Zhejiang University
    Advisor: Zhou Zhao
  • 2019, Research Intern, Robotics Institute, Carnegie Mellon University
    Advisor: David Held
  • 2018, Research Assistant, Massachusetts General Hospital
  • 2018, Research Intern, FABU Technology Co., Ltd.
    Advisor: Deng Cai
  • 2018, Software Engineer Intern, Tencent
  • 2017, Game Developer Intern, NetEase
  • 2016, Research Assistant, Visual Intelligence and Pattern Analysis, Zhejiang University
    Advisor: Mingli Song
  • Talks

  • Paper Presentation at CIKM. 10/2022 [Slides to be released.]
  • Paper Presentation at NAACL. 07/2022 [Slides]
  • Invited Talk at When CV Meets NLP. 05/2022 [Slides and video to be released.]
  • Paper Presentation at WWW 2021. 2021/04 [Video]
  • Services

  • Organizer: SoCalNLP 2022 [Website].
  • Program Committee Member: ICML2022(Pre-training), NAACL2022 SUKI.
  • Conference Reviewer: ACL ARR, ECCV, EMNLP, AAAI, EACL.
  • Volunteer and NSF Travel Award, CIKM.
  • Robert Noyce Fellow.
  • UCSB Faculty Recruitment CS Grad Representative.
  • Dancer

    Soccer Player