Xinyu Shi

Xinyu Shi

石新羽 ｜ CS PhD Student

xinyu.shi@uwaterloo.ca

Hi, I am Xinyu Shi, a fourth-year Ph.D. student at University of Waterloo in Canada. I am lucky to be advised by Prof. Jian Zhao in WVisdom Research Group, affiliated with the WaterlooHCI Lab.

My research focuses on Human-AI Interaction (HCI), particularly, Design Intelligence and AI-Powered Creativity Support Tools. The goal of my research is to design, develop, and evaluate interactive systems to facilitate graphic design authoring and enhance human creativity.

Outside of research, I am keen on exploring new possibilities in my life. I love skiing, playing badminton, rock climbing (only belay, no bouldering), and travelling. I have two cats, they are so sweet!

Interests
  • Human-Computer Interaction
  • Design Intelligence
  • Creativity Support Tool
  • Human-AI Co-Creation
Education

  • Ph.D. in Computer Science 2021 - Present

    University of Waterloo, Canada

  • B.Eng. in Software Engineering 2016 - 2020

    Xiamen University, China

News
  • 2025/01: Our paper about design intent expression, Brickify, is accepted by CHI'25!
  • 2024/05: Interning at Adobe Research (San Jose) this summer.
  • 2024/04: Super excited that Piet won Best Paper Award at CHI24!
  • 2024/01: Two papers are accepted by CHI'24!
  • 2023/11: Passed my Comprehensive Exam II, I am a Ph.D. candidate now!
  • 2023/05: Interning at Microsoft Research Asia (Beijing).
  • 2023/04: Attentding CHI 2023 to present De-Stijl at Hamburg, Germany!
  • 2022/06: FeMaSR is accepted by ACM MM'22 and selected as Oral Presentation.
  • 2022/05: Transferred from M.Math to Ph.D. program.
  • 2021/09: Fortunate to receive the 2021 Vector Scholarship from Vector Institute.
  • 2021/09: Started my journey at University of Waterloo!

Publications

  • Brickify: Enabling Expressive Design Intent Specification through Direct Manipulation on Design Tokens

    CHI 2025

    Brickify: Enabling Expressive Design Intent Specification through Direct Manipulation on Design Tokens
    Xinyu Shi, Yinghou Wang, Ryan Rossi, Jian Zhao
    In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems.
    PDF Video 30s Preview DOI

  • Comprehensive Sketching: Exploring Infographic Design Alternatives in Parallel

    CHI LBW 2025

    Comprehensive Sketching: Exploring Infographic Design Alternatives in Parallel
    Xinyu Shi, Shunan Guo, Jane Hoffswell, Gromit Yeuk-Yin Chan, Victor S. Bursztyn, Jian Zhao, Eunyee Koh
    In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems.
    PDF Video DOI

  • Exploring Interactive Color Palettes for Abstraction-Driven Exploratory Image Colorization

    CHI 2024

    Exploring Interactive Color Palettes for Abstraction-Driven Exploratory Image Colorization
    Xinyu Shi, Mingyu Liu, Ziqi Zhou, Ali Neshati, Ryan Rossi, Jian Zhao
    In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems.
    PDF Video 30s Preview DOI

  • De-Stijl: Facilitating Graphics Design with Interactive 2D Color Palette Recommendation

    CHI 2023

    De-Stijl: Facilitating Graphics Design with Interactive 2D Color Palette Recommendation
    Xinyu Shi, Ziqi Zhou, Julia Zhang, Ali Neshati, Anjul Tyagi, Ryan Rossi, Shunan Guo, Fan Du, Jian Zhao
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems.
    PDF Code Video 30s Preview Dataset (3.4G) DOI

  • Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priors

    MM 2022  ORAL PRESENTATION (TOP 5%)

    Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priors
    Chaofeng Chen, Xinyu Shi, Yipeng Qin, Xiaoming Li, Xiaoguang Han, Tao Yang, Shihui Guo
    In Proceedings of the 2022 ACM International Conference on Multimedia.
    PDF Code DOI

  • Teaching American Sign Language in Mixed Reality

    UbiComp 2021 / IMWUT 2020

    Teaching American Sign Language in Mixed Reality
    Qijia Shao, Amy Sniffen, Julien Blanchet, Megan E. Hillis, Xinyu Shi, Themistoklis K. Haris, Jason Liu, Melissa Malzkuhn, Lorna C. Quandt, James Mahoney, David J.M. Kraemer, Xia Zhou, Devin Balkcom
    In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies.
    PDF Video DOI

  • Accurate and Fast Classification of Foot Gestures for Virtual Locomotion

    ISMAR 2019

    Accurate and Fast Classification of Foot Gestures for Virtual Locomotion
    Xinyu Shi, Junjun Pan, Zeyong Hu, Juncong Lin, Shihui Guo, Minghong Liao, Ye Pan, Ligang Liu
    In Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality.
    PDF Video DOI

Contact