Hi! I'm Yujie Alice Lu.

social-16px_logo-github ui-16px-1_email-84 Created with Sketch. social-16px_logo-linkedin Created with Sketch. social-16px_logo-linkedin Created with Sketch. social-16px_logo-instagram Created with Sketch.

I am a second year CS PhD at UC Santa Barbara, advised by William Wang at Natural Language Processing Group. I closely work with Miguel Eckstein, Xin Eric Wang from UCSC and Wenhu Chen from UWaterloo. I obtained my bachelor’s degree from Chu Kochen Honors College, Zhejiang University, advised by Deng Cai and Mingli Song .

My current research focuses on Vision and Language. More specifically, I work on language grounding in vision/action, language-conditioned planning, and embodied agent.

Selected Publications

Neuro-Symbolic Causal Procedural Planning with Commonsense Prompting

Yujie Lu, Weixi Feng, Wanrong Zhu, Wenda Xu, Xin Eric Wang, Miguel Eckstein, William Yang Wang

International Conference on Learning Representations (ICLR), Spotlight, 2023

WikiWhy: Answering and Explaining Cause-and-Effect Questions

Matthew Ho, Aditya Sharma, Justin Chang, Michael Saxon, Sharon Levy, Yujie Lu, William Yang Wang

International Conference on Learning Representations (ICLR), Oral, 2023

Visualize Before You Write: Imagination-Guided Open-Ended Text Generation

Wanrong Zhu, An Yan, Yujie Lu, Wenda Xu, Xin Eric Wang, Miguel Eckstein, William Yang Wang

The European Chapter of the Association for Computational Linguistics (EACL), 2023

Breaking Out of the Ivory Tower: A Large-scale Analysis of Patent Citations to HCI Research

Hancheng Cao, Yujie Lu, Yuting Deng, Daniel McFarland, Michael S. Bernstein

The ACM CHI Conference on Human Factors in Computing Systems (CHI), 2023

ULN: Towards Underspecified Vision-and-Language Navigation

Weixi Feng, Tsu-Jui Fu, Yujie Lu, William Yang Wang

The Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022

Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error Synthesis

Wenda Xu, Yi-Lin Tuan, Yujie Lu, Michael S. Saxon, Lei Li, William Yang Wang

The Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022

MIC: Model-agnostic Integrated Cross-channel Recommenders

Yujie Lu*, Ping Nie*, Shengyu Zhang, Ming Zhao, Ruobing Xie, William Yang Wang, Yi Ren

The Conference on Information and Knowledge Management (CIKM), Oral Presentation, 2022 (* indicates equal contribution)

Imagination-Augmented Natural Language Understanding

Yujie Lu, Wanrong Zhu, Xin Eric Wang, Miguel Eckstein, William Yang Wang,

North American Chapter of the Association for Computational Linguistics (NAACL), Oral Presentation, 2022

Re4: Learning to Re-contrast, Re-attend, Re-construct for Multi-interest Recommendation

Shengyu Zhang, Lingxiao Yang, Dong Yao, Yujie Lu, Fuli Feng, Zhou Zhao, Tat-Seng Chua, Fei Wu

The Web Conference (WWW), 2022

Future-Aware Diverse Trends Framework for Recommendation

Yujie Lu, Shengyu Zhang, Yingxuan Huang, Luyao Wang, Xinyao Yu, Zhou Zhao, Fei Wu

The Web Conference (WWW), 2021

CLOUD: Contrastive Learning of Unsupervised Dynamics

Yujie Lu*, Jianren Wang*, Hang Zhao

The Conference on Robot Learning (CoRL), 2020 (* indicates equal contribution)

Selected Preprints

LAD: Language Augmented Diffusion for Reinforcement Learning

Edwin Zhang, Yujie Lu, William Yang Wang, Amy Zhang

Curiosity Driven Self-supervised Tactile Exploration of Unknown Objects

Yujie Lu*, Jianren Wang*, Vikash Kumar

Experience

  • 2022, Research Intern, Microsoft Research
    Advisor: Oriana Riva
  • 2019-2021, Applied Researcher, Tencent
  • 2019, Research Assistant, Digital Media Computing & Design Lab, Zhejiang University
    Advisor: Zhou Zhao
  • 2019, Research Intern, Robotics Institute, Carnegie Mellon University
    Advisor: David Held
  • 2018, Research Assistant, Massachusetts General Hospital
  • 2018, Research Intern, FABU Technology Co., Ltd.
    Advisor: Deng Cai
  • 2018, Software Engineer Intern, Tencent
  • 2017, Game Developer Intern, NetEase
  • 2016, Research Assistant, Visual Intelligence and Pattern Analysis, Zhejiang University
    Advisor: Mingli Song

    • Talks

  • Invited Talk at MLNLP. 02/2023 [Slides and video to be released.]
  • Paper Presentation at CIKM. 10/2022 [Slides to be released.]
  • Paper Presentation at NAACL. 07/2022 [Slides]
  • Invited Talk at When CV Meets NLP. 05/2022 [Slides and video to be released.]
  • Paper Presentation at WWW 2021. 2021/04 [Video]

    • Services

  • Organizer: SoCalNLP 2022 [Website].
  • Program Committee Member: ICML2022(Pre-training), NAACL2022 SUKI.
  • Conference Reviewer: ECCV, EMNLP, AAAI, EACL, ICASSP, ACL, ICCV.
  • Volunteer and NSF Travel Award, CIKM.
  • Robert Noyce Fellow.
  • UCSB Faculty Recruitment CS Grad Representative.

    • Dancer

    Soccer Player

    Drummer