| Curriculum Vitae
|
Research Interests
Data Visualization, Human-Computer Interaction, Augmented Reality, Applied Machine Learning
Appointments
01/2024 - Present
University of Minnesota, Twin Cities, Computer Science and Engineering
Assistant Professor
10/2021 - 12/2023
Harvard University, Visual Computing Group
PostDoc Fellow, with Hanspeter Pfister
10/2020 - 10/2021
University of California, San Diego, Design Lab
PostDoc Researcher, with Haijun Xia
Education
09/2015 - 09/2020
Ph.D. in Computer Science, Hong Kong University of Science and Technology
Advisor: Huamin Qu
Awarded Hong Kong Ph.D. Fellowship, the most prestigious fellowship in Hong Kong
09/2011 - 07/2015
B.Eng. in Software Engineering, South China University of Technology
Awarded Pacemaker to Merit Student, the highest honor (top 0.01%)
Awards and Honors
Awards
2023
Best Paper Award
ACM CHI'23
2022
Best Paper Honorable Mention Award, Twice
IEEE VIS'22
2022
Certificate of Distinction and Excellence in Teaching
Harvard University
2021
Best Paper Honorable Mention Award
IEEE VIS'21
2021
Special Recognitions for Outstanding Reviews
ACM IUI'21
2020
Special Recognitions for Outstanding Reviews
ACM CHI'21
2019 - 2020
Overseas Research Award
HK$ 30, 000, Hong Kong University of Science and Technology
2016
First Prize of the Design Thinking
China Academy of Art, Hong Kong University of Science and Technology
2015
Award of Excellence
Microsoft Research
2014
Meritorious Winner of Interdisciplinary Contest in Modeling
Consortium for Mathematics and Its Applications, USA
Fellowships and Scholarships
2015 - 2019
Hong Kong Ph.D. Fellowship
HK$ 265, 000 / year, Research Grants Council of Hong Kong
2013 - 2014
Pacemaker to Merit Student
¥10,000, South China University of Technology, the highest honor (top 0.1%)
2013 - 2014
National Scholarship
¥8,000, Ministry of Education of China
2013 - 2014
Tencent Technology Excellence Scholarship
¥5,000, Tencent Holdings Limited
2012 - 2013
National Scholarship
¥8,000, Ministry of Education of China
2011 - 2012
National Scholarship for Encouragement
¥5,000, Ministry of Education of China
Peer Reviewed Publications
In Data Vis and HCI, IEEE VIS (or InfoVis, SciVis, VAST) and ACM CHI are considered top tier conferences.
Papers in IEEE VIS will be included in the TVCG journal.
Journal Papers
2023J19
"RL-LABEL: A Deep Reinforcement Learning Approach Intended for AR Label Placement in Dynamic Scenarios."IEEE Transactions on Visualization and Computer Graphics (Proc. VIS'23)
J18
"VIRD: Immersive Match Video Analysis for High-Performance Badminton Coaching."IEEE Transactions on Visualization and Computer Graphics (Proc. VIS'23)
J17
"VoxAR: Adaptive Visualization of Volume Rendered Objects in Optical See-Through Augmented Reality."IEEE Transactions on Visualization and Computer Graphics (TVCG'23)
2022J16
"VCoach: A Customizable Visualization and Analysis System for Video-based Running Coaching."IEEE Transactions on Visualization and Computer Graphics (TVCG'22)
J15
"The Ball is in Our Court: Conducting Visualization Research with Sports Experts."IEEE Computer Graphics and Applications (CG&A'22)
J14
"Sporthesia: Augmenting Sports Videos Using Natural Language."IEEE Transactions on Visualization and Computer Graphics (Proc. VIS'22)
J13
"The Quest for Omnioculars: Embedded Visualization for Augmenting Basketball Game Viewing Experiences."IEEE Transactions on Visualization and Computer Graphics (Proc. VIS'22) — Best Paper Nominee
J12
"Exploring Interactions with Printed Data Visualizations in Augmented Reality."IEEE Transactions on Visualization and Computer Graphics (Proc. VIS'22) — Best Paper Nominee
J11
"PuzzleFixer: A Visual Reassembly System for Immersive Fragments Restoration."IEEE Transactions on Visualization and Computer Graphics (Proc. VIS'22)
2021J10
"Augmenting Sports Videos with VisCommentator."IEEE Transactions on Visualization and Computer Graphics (Proc. VIS'21) — Best Paper Nominee
J9
"TIVEE: Visual Exploration and Explanation of Badminton Tactics in Immersive Visualizations."IEEE Transactions on Visualization and Computer Graphics (Proc. VIS'21)
J8
"Applying Machine Learning Advances to Data Visualization: A Survey on ML4VIS."IEEE Transactions on Visualization and Computer Graphics (TVCG'21)
2020J7
"ShuttleSpace: Exploring and Analyzing Movement Trajectory in Immersive Visualization."IEEE Transactions on Visualization and Computer Graphics (Proc. InfoVis'20)
J6
"Visual Analysis of Discrimination in Machine Learning."IEEE Transactions on Visualization and Computer Graphics (Proc. InfoVis'20)
2019J5
"Towards Automated Infographic Design: Deep Learning-based Auto-Extraction of Extensible Timeline."IEEE Transactions on Visualization and Computer Graphics (Proc. InfoVis'19)
J4
"LassoNet: Deep Lasso-Selection of 3D Point Clouds."IEEE Transactions on Visualization and Computer Graphics (Proc. SciVis'19)
2018J3
"MARVisT: Authoring Glyph-based Visualization in Mobile Augmented Reality."IEEE Transactions on Visualization and Computer Graphics (TVCG'18)
2017J2
"Exploring the Design Space of Immersive Urban Analytics."Visual Informatics (JVI'17)
J1
"StreamExplorer: A Multi-Stage System for Visually Exploring Events in Social Streams."IEEE Transactions on Visualization and Computer Graphics (TVCG'17)
Conference Papers
2024C14
"WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualization."UIST
C13
"Sportify: Question Answering with Embedded Visualizations and Personified Narratives for Sports Video."IEEE Transactions on Visualization and Computer Graphics (Proc. VIS'24)
C12
"Sketch Then Generate: Providing Incremental User Feedback and Guiding LLM Code Generation through Language-Oriented Code Sketches."ArXiv
2023C11
"Quantifying the Impact of XR Visual Guidance on User Performance Using a Large-Scale Virtual Assembly Experiment."IEEE Transactions on Visualization and Computer Graphics (Proc. VIS'23)
C10
"Beyond Generating Code: Evaluating GPT on a Data Visualization Course."IEEE VIS'23 Workshop on VISxEdu
C9
"ARrow: A Real-Time AR Rowing Coach."Eurographics Conference on Visualization (Proc. EuroVis'23) — Best Paper Nominee
C8
"iBall: Augmenting Basketball Videos with Gaze-moderated Embedded Visualizations."ACM Conference on Human Factors in Computing Systems (Proc. CHI'23)
C7
"DataParticles: Block-based and Language-oriented Authoring of Animated Unit Visualization."ACM Conference on Human Factors in Computing Systems (Proc. CHI'23) — Best Paper
2022C6
"Millions and Billions of Views: Understanding Popular Science and Knowledge Communication on Video-Sharing Platforms."ACM Conference on Learning at Scale (Proc. L@S'22)
C5
"CrossData: Leveraging Text-Data Connections for Authoring Data Documents."ACM Conference on Human Factors in Computing Systems (Proc. CHI'22)
2020C4
"Augmenting Static Visualizations with PapARVis Designer."ACM Conference on Human Factors in Computing Systems (Proc. CHI'20)
2016C3
"Animated Narrative Visualization for Video Clickstream Data."ACM SIGGRAPH ASIA Visualization Symposium
C2
"Blossom: Design of a Tangible Interface for Improving Intergenerational Communication for the Elderly."ACM Interactive Technology and Ageing Populations (Proc. ITAP'16)
C1
"STAC: Enhancing Stacked Graphs for Time Series Analysis."IEEE Pacific Visualization Symposium (Proc. PacificVis'16)
Workshop Papers
2017W1
"Immersive Urban Analytics through Exploded Views."IEEE VIS'17 Workshop on Immersive Analytics
Research Internships and Visits
09/2019 - 12/2019
University of Edinburgh, Visual Interactive Data Group
Visting Researcher, with Benjamin Bach
Spring/2017
Zhejiang University, State Key Lab of CAD&CG
Research Intern, with Yingcai Wu
Spring/2015
Zhejiang University, State Key Lab of CAD&CG
Research Intern, with Yingcai Wu
06/2014 - 01/2015
Microsoft Research Asia, Internet Graphics Group
Research Intern, with Yingcai Wu
Grants
2022 - 2023
Physical Sciences & Engineering Accelerator Funding
$110, 000, Harvard's Grid Accelerator, PI: Hanspeter Pfister
In review. I led the writing of this grant proposal
2022 - 2023
Harvard Data Science Initiative Azure Funding
$23,000 in credit, Harvard University, PI: Chen Zhu-Tian
2021 - 2024
General Research Fund, Grant no. 16210321
HK$ 838, 393, Research Grants Council of Hong Kong, PI: Huamin Qu
I led the writing of this grant proposal
2020 - 2021
Research Travel Grant
Hong Kong University of Science and Technology
2019 - 2020
Research Travel Grant
Hong Kong University of Science and Technology
2018 - 2019
Research Travel Grant
Hong Kong University of Science and Technology
Teaching
Fall/2022
Harvard University, CS171: Data Visualization
Teaching Fellow
Spring/2022
Harvard University, CS271: Topics in Data Visualization
Teaching Fellow
Winter/2021
University of California, San Diego, COGSCI220: Information Visualization Seminar
Teaching Assistant
Fall/2018
Hong Kong University of Science and Technology, COMP2711: Discrete Mathematical Tools for CS
Teaching Assistant
Spring/2018
Hong Kong University of Science and Technology, COMP4901f: Data Visualization
Teaching Assistant
Mentoring
Doctoral Students
2022 - Present
Rima Cao, University of California San Diego [C7]
2021 - Present
Tica Lin, Harvard University[J13, J15, C8]
2020 - Present
Xiangtong Chu, Zhejiang University [J8, J9, J11]
2020 - 2022
Shuainan Ye, Zhejiang University [J6, J8, J9, J11]
2020 - 2021
Hui Xin Wu, University of California, San Diego [C6]
2019 - 2022
Wai Tong, Hong Kong University of Science and Technology [C4, J12]
Master Students
2022 - Present
Alexandre Aouididi, EPFL, visiting student in Harvard
2021 - 2022
Elena Lannucci, ETH, visiting student at Harvard
2021 - 2022
Daniele Chiappalupi, ETH, visiting student at Harvard [J13]
2021 - 2022
Anita Mahinpei, Harvard University. Thesis Committee
2019
Zhiguang Yang, Chinese Academy of Sciences [J4]
Selected Undergraduate Students
2022 - Present
Brian Nzuki, Harvard University. Supervisor in CS91R
2022 - Present
Cindy Tian, Harvard University
Summer / 2022
Jerry Shan, University of California, Berkeley, research intern at Harvard
2021 - 2022
Qisen Yang, Zhejiang University, research intern at Harvard [J14]
Spring / 2022
Cassie Wang, Harvard University. Supervisor in CS91R
2017 - 2018
Yifang Wang, Zhejiang University [J2, J3]
2017
Tianchen Sun, Zhejiang University [J2]
Invited Talks
Guest Lecturer
11 / 2022
Human-AI Systems for Visualizing Data in Augmented Reality
University of California, San Diego, COGS 120
06 / 2021
Situated Visualization
Zhejiang University, Summer School on Visual Analytics
Seminar Talks
07 / 2021
Visualizing Data in Augmented Reality
Harvard University, Visual Computing Group
12 / 2020
Data Visualization in Augmented Reality
University of California San Diego, Design Lab
01 / 2020
Towards Futuristic Visual StoryTelling: Authoring Data-Driven Infographics in Augmented Reality
Shandong University, Interactive Data Exploration System (IDEAS) Lab
12 / 2019
Towards Futuristic Visual StoryTelling: Authoring Data-Driven Infographics in Augmented Reality
Ant Financial, UX group
11 / 2019
Towards Futuristic Visual StoryTelling: Authoring Data-Driven Infographics in Augmented Reality
University of Edinburgh, Visual Interactive Data Group
07 / 2019
Towards Futuristic Visual StoryTelling: Authoring Data-Driven Infographics in Augmented Reality
Zhejiang Lab
10 / 2019
InfoVis in Augmented Reality
Microsoft Vancouver
Academic Service
Program Committee
2023
ACM Conference on Intelligent User Interfaces (IUI)
2022 - 2023
IEEE Pacific Visualization Symposium (PacificVis)
2022 - 2023
China Visualization and Visual Analytics Conference (ChinaVis)
Conference Review
2018 - 2022
IEEE VIS Conference (VAST, InfoVis, and SciVis)
2019 - 2022
IEEE Pacific Visualization Symposium (PacificVis)
2021 - 2022
IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
2021
IEEE Eurographics / VGTC Symposium on Visualization (EuroVis)
2020 - 2023
ACM Conference on Human Factors in Computing Systems (CHI)
2022
ACM Symposium on User Interface Software and Technology (UIST)
2022
ACM Conference on Intelligent User Interfaces (IUI)
2021
ACM Conference on Designing Interactive Systems (DIS)
2019
ACM Symposium on Virtual Reality Software and Technology (VRST)
2019 - 2022
China Visualization and Visual Analytics Conference (ChinaVis)
Journal Review
2022
ACM Transactions on Interactive Intelligent Systems (TiiS)
2020 - 2022
IEEE Transactions on Visualization and Computer Graphics (TVCG)
2020 - 2021
IEEE Computer Graphics and Applications (CG&A)
2019
ACM Transactions on Graphics (TOG)
Patents
P5
Johanna Beyer, Chen Zhu-Tian, Man-Hsin Lin, and Hanspeter Pfister. Augmenting Basketball Videos with Gaze-moderated Embedded Visualizations. 2022. In preparation.
P4
Chen Zhu-Tian, Man-Hsin Lin, and Hanspeter Pfister. Embedded Visualization for Augmenting Viewing Experiences. 2022. U.S. Provisional Application No. 63/394,683.
P3
Chen Zhu-Tian, and Hanspeter Pfister. Augmenting Sports Videos Using Natural Language. 2022. U.S. Provisional Application No. 63/391,343.
P2
Yingcai Wu, Chen Zhu-Tian, Shuainan Ye, and Xiangtong Chu. A method for creating augmented videos of racket-based sports. 2021. CN113610003A.
P1
Yingcai Wu, Chen Zhu-Tian, Shuainan Ye, and Xiangtong Chu. A method for designing augmented videos of racket-based sports with visualizations. 2021. CN113642441A.