publications

ACM CHI and ACM UIST are top conferences for technical HCI work.

2025

  1. Thought as a Substrate in Human-AI Interaction
    Xingyu Bruce Liu
    In UIST 2025 Doctoral Symposium (UIST ’25)
    PDF DOI
  2. Interacting with Thoughtful AI
    Xingyu Bruce Liu, Haijun Xia, and Xiang Anthony Chen
    In CHI 2025 Workshop on Tools for Thought: Research and Design for Understanding, Protecting, and Augmenting Human Cognition with Generative AI (CHI ’25)
    PDF arXiv
  3. Proactive Conversational Agents with Inner Thoughts
    Xingyu Bruce Liu, Shitao Fang, Weiyan Shi, Chien-Sheng Wu, Takeo Igarashi, and Xiang Anthony Chen
    In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI ’25)
    PDF arXiv Code Website DOI

2024

  1. Human I/O: Towards a Unified Approach to Detecting Situational Impairments
    Xingyu Bruce Liu, Jiaohao Nick Li, David Kim, Xiang Anthony Chen, and Ruofei Du
    In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI ’24)
    🏅 Best Paper Honorable Mention
    PDF Blog Website DOI

2023

  1. Experiencing Visual Captions: Augmented Communication with Real-Time Visuals Using Large Language Models
    Xingyu Bruce Liu, Vladimir Kirilyuk, Xiuxiu Yuan, Peggy Chi, Alex Olwal, Xiang Anthony Chen, and Ruofei Du
    In Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST ’23 Adjunct)
    DOI
  2. Social Wormholes: Exploring Preferences and Opportunities for Distributed and Physically-Grounded Social Connections
    Xingyu Bruce Liu*, Joanne Leong*, Yuanyang Teng*, Hanseul Jun, Sven Kratz, Yu Jiang Tham, Andrés Monroy-Hernández, Brian A. Smith, and Rajan Vaish
    Proc. ACM Hum.-Comput. Interact. (CSCW ’23)
    DOI
  3. Visual Captions: Augmenting Verbal Communication with On-the-fly Visuals
    Xingyu Bruce Liu, Vladimir Kirilyuk, Xiuxiu Yuan, Alex Olwal, Peggy Chi, Xiang Anthony Chen, and Ruofei Du
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23)
    PDF Blog CodeVideo Website DOI
  4. Rapsai: Accelerating Machine Learning Prototyping of Multimedia Applications Through Visual Programming
    Ruofei Du, Na Li, Jing Jin, Michelle Carney, Scott Miles, Maria Kleiner, Xiuxiu Yuan, Yinda Zhang, Anuva Kulkarni, Xingyu Bruce Liu, Sergio Escolano, Abhishek Kar, Alex Olwal, Ping Yu, Ram Iyengar, and Adarsh Kowdle
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23)
    🏅 Best Paper Honorable Mention
    PDFVideo DOI
  5. Modeling and Improving Text Stability in Live Captions
    Xingyu Bruce Liu, Jun Zhang, Leonardo Ferrer, Susan Xu, Vikas Bahirwani, Boris Smus, Alex Olwal, and Ruofei Du
    In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23)
    PDFVideo DOI

2022

  1. CrossA11y: Identifying Video Accessibility Issues via Cross-Modal Grounding
    Xingyu Bruce Liu, Ruolin Wang, Dingzeyu Li, Xiang Anthony Chen, and Amy Pavel
    In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22)
    🏆 Best Paper Award
    PDFVideo Website DOI

2021

  1. What Makes Videos Accessible to Blind and Visually Impaired People?
    Xingyu Liu, Patrick Carrington, Xiang Anthony Chen, and Amy Pavel
    In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21)
    PDFVideo DOI

2019

  1. Making Memes Accessible
    Cole Gleason, Amy Pavel, Xingyu Liu, Patrick Carrington, Lydia B. Chilton, and Jeffrey P. Bigham
    In Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’19)
    PDF Blog Website DOI