Xinyu Shi

Xinyu Shi

石新羽 | CS PhD Student

xinyu.shi@uwaterloo.ca

Hi, I am Xinyu Shi, a fifth-year Ph.D. candidate at University of Waterloo in Canada. I am lucky to be advised by Prof. Jian Zhao in WVisdom Research Group, affiliated with the WaterlooHCI Lab. During my PhD, I have interned at Adobe Research (twice) and Microsoft Research Asia.

I am a researcher in Human-Computer Interaction (HCI) and Human-Centered AI. I endeavor to answer the question of how we can exploit the machine intelligence to augment human creativity in creative problem solving, with a primary focus on visual media authoring. To achieve this, I design, develop, and evaluate meaningful and useful interactive visual abstractions, serving as a mediator between users and machine, to enable powerful ways of thinking, visual intent communication, and visual media authoring.

Outside of research, I am keen on exploring new possibilities in my life. I love skiing, playing badminton, rock climbing (only belay, no bouldering), and travelling. I have two cats, they are so sweet!

Interests
  • Human-Computer Interaction
  • Human-Centered AI
  • Computational Creativity
  • Visual Media Authoring
Education
  • Ph.D. in Computer Science 2021 - Present

    University of Waterloo, Canada

  • B.Eng. in Software Engineering 2016 - 2020

    Xiamen University, China

News
  • 2025/11: Gave an invited talk at UCSD Design Lab (Title: Interactive Visual Abstractions for Steerable Creativity)
  • 2025/11: Gave an invited talk at UofT iSchool (Title: Interactive Visual Abstractions for Steerable Creativity)
  • 2025/06: Interning at Adobe Research with Rubaiat, Li-Yi, and Cherry this summer!
  • 2025/01: Our paper about design intent expression, Brickify, is accepted by CHI'25!
  • 2024/05: Interning at Adobe Research (San Jose) with Shunan, Jane, Gromit, and Eunyee this summer.
  • 2024/04: Super excited that Piet won Best Paper Award at CHI24!
  • 2024/01: Two papers are accepted by CHI'24!
  • 2023/11: Passed my Comprehensive Exam II, I am a Ph.D. candidate now!
  • 2023/05: Interning at Microsoft Research Asia (Beijing).
  • 2023/04: Attentding CHI 2023 to present De-Stijl at Hamburg, Germany!
  • 2022/06: FeMaSR is accepted by ACM MM'22 and selected as Oral Presentation.
  • 2022/05: Transferred from M.Math to Ph.D. program.
  • 2021/09: Fortunate to receive the 2021 Vector Scholarship from Vector Institute.
  • 2021/09: Started my journey at University of Waterloo!

Publications

  • Under Review

    Notational Animating: An Interactive Approach to Creating and Editing Animation Keyframes

    Under Review.
    Coming soon

  • Under Review

    Diagrammatic Sketching: Exploring Infographic Design Alternatives in Parallel

    Under Review.
    Coming soon

  • CHI 2025

    Brickify: Enabling Expressive Design Intent Specification through Direct Manipulation on Design Tokens

    In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems.
    PDF Video 30s Preview DOI

  • CHI 2024

    Exploring Interactive Color Palettes for Abstraction-Driven Exploratory Image Colorization

    In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems.
    PDF Video 30s Preview DOI

  • CHI 2023

    De-Stijl: Facilitating Graphics Design with Interactive 2D Color Palette Recommendation

    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems.
    PDF Code Video 30s Preview Dataset (3.4G) DOI

  • MM 2022  ORAL PRESENTATION (TOP 5%)

    Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priors

    In Proceedings of the 2022 ACM International Conference on Multimedia.
    PDF Code DOI

  • UbiComp 2021 / IMWUT 2020

    Teaching American Sign Language in Mixed Reality

    In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies.
    PDF Video DOI

  • ISMAR 2019

    Accurate and Fast Classification of Foot Gestures for Virtual Locomotion

    In Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality.
    PDF Video DOI

Extended Abstracts

  • CHI LBW 2025

    Comprehensive Sketching: Exploring Infographic Design Alternatives in Parallel

    In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems.
    PDF Video DOI

Contact