publications

ACM CHI and ACM UIST are top conferences for technical HCI work.

2024

  1. Human I/O: Towards a Unified Approach to Detecting Situational Impairments
    Xingyu Bruce Liu, Jiaohao Nick Li, David Kim, Xiang Anthony Chen, and Ruofei Du
    In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI ’24)
    PDF DOI

2023

  1. Experiencing Visual Captions: Augmented Communication with Real-Time Visuals Using Large Language Models
    Xingyu Bruce Liu, Vladimir Kirilyuk, Xiuxiu Yuan, Peggy Chi, Alex Olwal, Xiang Anthony Chen, and Ruofei Du
    In Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST ’23 Adjunct)
    DOI
  2. Social Wormholes: Exploring Preferences and Opportunities for Distributed and Physically-Grounded Social Connections
    Xingyu Bruce Liu*, Joanne Leong*, Yuanyang Teng*, Hanseul Jun, Sven Kratz, Yu Jiang Tham, Andrés Monroy-Hernández, Brian A. Smith, and Rajan Vaish
    Proc. ACM Hum.-Comput. Interact. (CSCW ’23)
    DOI
  3. Visual Captions: Augmenting Verbal Communication with On-the-fly Visuals
    Xingyu Bruce Liu, Vladimir Kirilyuk, Xiuxiu Yuan, Alex Olwal, Peggy Chi, Xiang Anthony Chen, and Ruofei Du
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23)
    PDF Blog CodeVideo Website DOI
  4. Rapsai: Accelerating Machine Learning Prototyping of Multimedia Applications Through Visual Programming
    Ruofei Du, Na Li, Jing Jin, Michelle Carney, Scott Miles, Maria Kleiner, Xiuxiu Yuan, Yinda Zhang, Anuva Kulkarni, Xingyu Bruce Liu, Sergio Escolano, Abhishek Kar, Alex Olwal, Ping Yu, Ram Iyengar, and Adarsh Kowdle
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23)
    🏅 Honorable Mention
    PDFVideo DOI
  5. Modeling and Improving Text Stability in Live Captions
    Xingyu Bruce Liu, Jun Zhang, Leonardo Ferrer, Susan Xu, Vikas Bahirwani, Boris Smus, Alex Olwal, and Ruofei Du
    In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23)
    PDFVideo DOI

2022

  1. CrossA11y: Identifying Video Accessibility Issues via Cross-Modal Grounding
    Xingyu Bruce Liu, Ruolin Wang, Dingzeyu Li, Xiang Anthony Chen, and Amy Pavel
    In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22)
    🏆 Best Paper Award
    PDFVideo Website DOI

2021

  1. What Makes Videos Accessible to Blind and Visually Impaired People?
    Xingyu Liu, Patrick Carrington, Xiang Anthony Chen, and Amy Pavel
    In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21)
    PDFVideo Website DOI

2019

  1. Making Memes Accessible
    Cole Gleason, Amy Pavel, Xingyu Liu, Patrick Carrington, Lydia B. Chilton, and Jeffrey P. Bigham
    In Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’19)
    PDF Blog Website DOI