Xingyu Bruce Liu


Greetings! I am a Ph.D. student at the UCLA HCI lab advised by Professor Xiang ‘Anthony’ Chen.

My research interests are in Human-Computer Interaction (HCI), specifically in modeling, supporting and augmenting human abilities in a multimodal context. Leveraging techniques from AI and HCI, I create novel experiences for accessibility, communication and augmented reality.

My work has been recognized and supported by an Amazon Ph.D. Fellowship🏅 (2023), an ACM UIST Best Paper Award 🏆 (2022), an ED Rice Outstanding Master Student Award 🎓 (2023), and a Distinguished Master’s Thesis Research Award 🎓 (2022) at UCLA. I also held research internships at Google and Snap Research.


Oct 29, 2023 Attending UIST 2023 in San Francisco, demoing Visual Captions!
Jun 20, 2023 Visited and gave a talk at the Pi Lab at Tsinghua University!
Jun 5, 2023 Honored to be selected as a 2023 Amazon Ph.D. Fellow!
Apr 20, 2023 Started my 5 months visit at the Igarashi Lab at The University of Tokyo!
Apr 14, 2023 Gave a talk on AI for HCI at the AIST Creative HCI Seminar.

selected publications

  1. Visual Captions: Augmenting Verbal Communication with On-the-fly Visuals
    Xingyu "Bruce" Liu, Vladimir Kirilyuk, Xiuxiu Yuan, Alex OlwalPeggy ChiXiang Anthony Chen, and Ruofei Du
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems 2023
  2. CrossA11y: Identifying Video Accessibility Issues via Cross-Modal Grounding
    Xingyu "Bruce" LiuRuolin WangDingzeyu LiXiang Anthony Chen, and Amy Pavel
    In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology 2022
  3. What Makes Videos Accessible to Blind and Visually Impaired People?
    In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems 2021