Seminar:
Augment Content Interaction Experiences for 3D

ABSTRACT

3D applications, valued for their intuitiveness and interactivity, have great potential to enhance content interactions. However, it is crucial to recognize the challenges that accompany their benefits. For example, while browser-based 3D viewers offer a lightweight and intuitive approach to interact with 3D models, navigating and interacting with this extra dimension on a 2D display can be hard for those without prior 3D experience. Although Mixed Reality (MR) offers a new way to blend the physical and digital worlds, the digital content often disconnects with the physical 3D spaces. Virtual Reality (VR) is promising to visualize 3D data like medical images, but interacting with this data remains a challenge. The absence of physical support and depth perception can limit our ability to make precise annotations, a critical task in medical imaging-focused applications. In this talk, I will share examples of how new interactive techniques and systems can enhance content interaction experience for 3D. These 3D experiences encompass those rendered on standard 2D displays, and those experienced through emerging headmounted displays. Grounded on specific applications, first, I will demonstrate how emergent Generative AI can streamline the interactions with 3D models on 2D displays. I will then introduce a new interactive technique to connect instruction documents with physical 3D spaces looked through MR. Finally, I will showcase how we can better augment with 3D data like medical images in VR.

Chen Chen

University of California, San Diego

Chen Chen is a Ph.D. Candidate (ABD) from the Department of Computer Science and Engineering, The Design Lab, and Qualcomm Institute at the California Institute for Telecommunications and Information Technology (CalIT2) at University of California San Diego. Chen works on Human-Computer Interactions, eXtended Reality and Accessibility research. His work aims to augment content interaction experiences for a wide variety of interfaces and users. His research has been published in multiple toptier HCI, XR, Accessibility and Mobile Computing conferences and journals. His research has been recognized by the prestigious Distinguished Paper Award by ACM IMWUT/UbiComp, Honorable Mentioned Award by ACM CHI, Best Poster Award by ACM SenSys, and the finalist of Adobe Research Fellowship and Qualcomm Innovation Fellowship. Some of Chen's research has resulted in patents and been highlighted at public events such as Adobe MAX. Chen is a former researcher at Microsoft Research, Adobe Research and Carnegie Mellon University. Chen holds a M.S. degree from Carnegie Mellon University and a B.Eng. degree from the University of Nottingham. For more information about Chen, please refer to https://chen-chen.me.