Hi there 👋. I am currently a Fifth Year Computer Science Ph.D. student at Carnegie Mellon University. I work with Professor Nik Martelaro in the Augmented Design Capability Studio. I did internships at Adobe Research and Runway. My research is also supported by Toyota Research Institute and Accenture Labs.
Research Interest
My main research interest focuses on steering tools for generative AI design. To explore this space, I have developed a sketching interface (Inkspire), a puzzle-like interface (Jigsaw), and a latent space map interface (VideoMap).
Another thread of my research is on AI-assisted video creation tools, including tools for matching sounds to visuals (Soundify), detecting highlight moments (Videogenic), and organizing video assets (VideoMap).
Papers
Inkspire: Sketching Product Designs with AI
David Chuan-En Lin, Hyeonsu B Kang, Nikolas Martelaro, Aniket Kittur, Yan-Ying Chen, Matthew K. Hong
We developed a tool that enables designers to sketch product designs with AI scaffolding beneath the canvas and analogy inspirations.
Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models
David Chuan-En Lin, Nikolas Martelaro
We developed a tool for combining AI models across different capabilities and modalities by combining them like puzzle pieces.
VideoMap: Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Space
David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang, Nikolas Martelaro
We developed a proof-of-concept video editing interface that operates on video frames projected onto a latent space.
Videogenic: Identifying Highlight Moments in Videos with Professional Photographs as a Prior
David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang, Nikolas Martelaro
We developed a system for detecting highlight moments by leveraging photographs taken by photographers.
Soundify: Matching Sound Effects to Video
David Chuan-En Lin, Anastasis Germanidis, Cristóbal Valenzuela, Yining Shi, Nikolas Martelaro
We developed a system to assist video editors in adding content-aware spatial sound effects to video.
Learning Personal Style from Few Examples
David Chuan-En Lin, Nikolas Martelaro
We developed a model for learning personal graphic design style from a handful of examples.
ARchitect: Building Interactive Virtual Experiences from Physical Affordances by Bringing Human-in-the-Loop
Chuan-En Lin*, Ta Ying Cheng*, Xiaojuan Ma(*=equal contribution)
We explored an asymmetric workflow of an AR builder and a VR player for creating VR experiences that incorporate real-world interaction affordances.
SeqDynamics: Visual Analytics for Evaluating Online Problem-solving Dynamics
Meng Xia, Min Xu, Chuan-En Lin, Ta Ying Cheng, Huamin Qu, Xiaojuan Ma
We developed an interactive visual analytics system for instructors to evaluate problem-solving dynamics of student learners.
Service
Reviewer
- ACM Conference on Human Factors in Computing Systems (CHI)
- ACM Symposium on User Interface Software and Technology (UIST)
CMU HCII PhD Admissions Committee
Last updated on September 2024.