David Chuan-En Lin
chuanenl [at] cs.cmu.edu
Hi there 👋. I am currently a Fifth Year Computer Science Ph.D. student at Carnegie Mellon University. I work with Professor Nik Martelaro in the Augmented Design Capability Studio. I did internships at
Adobe Research and
Runway. My research is also supported by
Toyota Research Institute and
Accenture Labs. I am organizing the CMU Interactive AI working group.
Research Interest
My main research interest focuses on steering tools for generative AI design. To explore this space, I have developed a sketching interface (Inkspire), a puzzle-like interface (Jigsaw), and a latent space map interface (VideoMap).
Another thread of my research is on AI-assisted video creation tools, including tools for matching sounds to visuals (Soundify), detecting highlight moments (Videogenic), and organizing video assets (VideoMap).
Papers
Inkspire: Sketching Product Designs with AI
David Chuan-En Lin, Hyeonsu B Kang, Nikolas Martelaro, Aniket Kittur, Yan-Ying Chen, Matthew K. Hong
We developed a tool that enables designers to sketch product designs with AI scaffolding beneath the canvas and analogy inspirations.
Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models
David Chuan-En Lin, Nikolas Martelaro
We developed a tool for combining AI models across different capabilities and modalities by combining them like puzzle pieces.
VideoMap: Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Space
David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang, Nikolas Martelaro
We developed a proof-of-concept video editing interface that operates on video frames projected onto a latent space.
Videogenic: Identifying Highlight Moments in Videos with Professional Photographs as a Prior
David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang, Nikolas Martelaro
We developed a system for detecting highlight moments by leveraging photographs taken by photographers.
Soundify: Matching Sound Effects to Video
David Chuan-En Lin, Anastasis Germanidis, Cristóbal Valenzuela, Yining Shi, Nikolas Martelaro
We developed a system to assist video editors in adding content-aware spatial sound effects to video.
Learning Personal Style from Few Examples
David Chuan-En Lin, Nikolas Martelaro
We developed a model for learning personal graphic design style from a handful of examples.
ARchitect: Building Interactive Virtual Experiences from Physical Affordances by Bringing Human-in-the-Loop
Chuan-En Lin*, Ta Ying Cheng*, Xiaojuan Ma(*=equal contribution)
We explored an asymmetric workflow of an AR builder and a VR player for creating VR experiences that incorporate real-world interaction affordances.
SeqDynamics: Visual Analytics for Evaluating Online Problem-solving Dynamics
Meng Xia, Min Xu, Chuan-En Lin, Ta Ying Cheng, Huamin Qu, Xiaojuan Ma
We developed an interactive visual analytics system for instructors to evaluate problem-solving dynamics of student learners.
Service
- Reviewing ACM CHIACM UISTACM MobileHCI
- Organizing CMU Interactive AIFishackathon Hong KonghackUST
- Admissions Committee CMU School of Computer Science HCI Ph.D. Program
Other Projects
Last updated on September 2024.