Xinyu Shi

Xinyu Shi

石新羽 | CS PhD Student

xinyu.shi@uwaterloo.ca

I'm on the job market!

I am actively seeking for tenure-track faculty or postdoc positions in academia and research roles in industry for 2026. Feel free to email me about opportunities that might be a good fit!

Hi, I am Xinyu Shi, a fifth-year Ph.D. candidate at University of Waterloo in Canada. I work on Human-Computer Interaction, Human-Centered AI, and Computational Creativity. I am lucky to be advised by Prof. Jian Zhao in WVisdom Research Group, affiliated with the WaterlooHCI Lab. During my PhD, I have interned at Adobe Research (twice) and Microsoft Research Asia. My work has been recognized with a Best Paper Award and an Honorable Mention Award at CHI.

My research defines new interaction paradigms for AI-powered creativity support tools that make the implicit structures behind the creative process explicit to augment human’s creative thinking and align machine-generated results with human intention. In specific, I design meaningful and useful interactive visual abstractions to represent and manipulate visual media, which serve as the interaction mediator between human creators and machine intelligence to enable powerful ways of thinking, communication, and design.

Outside of research, I am keen on exploring new possibilities in my life. I love skiing, playing badminton, rock climbing (only belay, no bouldering), and travelling. I am the mom of two cats (a boy and a girl), they are super sweet!

News
  • 2026/02: Our paper Notational Animating received Best Paper Honorable Mention Award at CHI 2026!
  • 2025/11: Gave an invited talk at UCSD Design Lab (Title: Interactive Visual Abstractions for Steerable Creativity)
  • 2025/11: Gave an invited talk at UofT iSchool (Title: Interactive Visual Abstractions for Steerable Creativity)
  • 2025/06: Interning at Adobe Research with Rubaiat, Li-Yi, and Cherry this summer!
  • 2025/01: Our paper about design intent expression, Brickify, is accepted by CHI'25!
  • 2024/05: Interning at Adobe Research (San Jose) with Shunan, Jane, Gromit, and Eunyee this summer.
  • 2024/04: Super excited that Piet won Best Paper Award at CHI24!
  • 2024/01: Two papers are accepted by CHI'24!
  • 2023/11: Passed my Comprehensive Exam II, I am a Ph.D. candidate now!
  • 2023/05: Interning at Microsoft Research Asia (Beijing).
  • 2023/04: Attentding CHI 2023 to present De-Stijl at Hamburg, Germany!
  • 2022/06: FeMaSR is accepted by ACM MM'22 and selected as Oral Presentation.
  • 2022/05: Transferred from M.Math to Ph.D. program.
  • 2021/09: Fortunate to receive the 2021 Vector Scholarship from Vector Institute.
  • 2021/09: Started my journey at University of Waterloo!

PUBLICATIONS

  • Notational Animating: An Interactive Approach to Creating and Editing Animation Keyframes

    CHI 2026 In Proc. of ACM CHI Conference on Human Factors in Computing Systems.

    BEST PAPER HONORABLE MENTION

  • Brickify: Enabling Expressive Design Intent Specification through Direct Manipulation on Design Tokens

    CHI 2025 In Proc. of ACM CHI Conference on Human Factors in Computing Systems.

  • Exploring Interactive Color Palettes for Abstraction-Driven Exploratory Image Colorization

    CHI 2024 In Proc. of ACM CHI Conference on Human Factors in Computing Systems.

  • De-Stijl: Facilitating Graphics Design with Interactive 2D Color Palette Recommendation

    CHI 2023 In Proc. of ACM CHI Conference on Human Factors in Computing Systems.

  • Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priors

    MM 2022 In Proc. of ACM International Conference on Multimedia.

    ORAL PRESENTATION (TOP 5%)

  • Teaching American Sign Language in Mixed Reality

    UbiComp 2021 / IMWUT 2020 Proc. of ACM Interactive, Mobile, Wearable and Ubiquitous Technologies.

  • Accurate and Fast Classification of Foot Gestures for Virtual Locomotion

    ISMAR 2019 In Proc. of IEEE International Symposium on Mixed and Augmented Reality.

EXTENDED ABSTRACTS, WORKSHOPS

  • BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent

    NeurIPS Workshop 2025 NeurIPS 2025 Workshop on Multi-Turn Interactions in Large Language Models.

    SPOTLIGHT

  • Comprehensive Sketching: Exploring Infographic Design Alternatives in Parallel

    CHI LBW 2025 In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems.