David Lin

chuanenl[at]cs.cmu.edu

Hi there 👋. I am a Final Year Computer Science PhD student at Carnegie Mellon University. I work with Professor Nik Martelaro in the Augmented Design Capability Studio. Previously, I did research internships at Adobe Research and Runway. During my leisure time, I document my travels and listen to Avicii music.

Research Summary

I build human🤝AI tools for designers.

I develop interactive tools for designers to co-create with AI capabilities using intuitive high-level abstractions. For example, ✏️ sketching with AI-generated scaffolding, 🧩 assembling AI model puzzle pieces, and 🗺️ exploring latent space maps.

I work on both interaction design and machine learning modeling to support these abstractions, coming from my mixed background in Human-Computer Interaction and Computer Vision.

My projects spans multiple modalities, including 🎞 video, 🔊 audio, 🧱 3D, 🔤 text, 🖼️ image, and ✏️ sketching.

My research impacts design practice by blending AI capabilities into designers' natural workflows, improving designers' creative exploration and productivity.

Publications

CHI '25

Inkspire: Supporting Design Exploration with Generative AI through Analogical Sketching

David Chuan-En Lin, Hyeonsu Kang, Nikolas Martelaro, Aniket Kittur, Yan-Ying Chen, Matthew Hong

We developed a sketching tool that allows designers to sketch product designs with analogical inspirations and AI-generated shadows beneath the canvas.

Full Paper Short Paper Video Talk Cite

CHI '25

BioSpark: Beyond Analogical Inspiration to LLM-augmented Transfer

Hyeonsu Kang, David Chuan-En Lin, Yan-Ying Chen, Matthew Hong, Nikolas Martelaro, Aniket Kittur

We developed an interactive system that helps designers discover analogical biology inspirations and transfer them to target domains.

Paper Talk Cite

CHI '25 UI AI Workshop

Visual Lyrics: Automatic Generation of Animated Lyric Videos

David Chuan-En Lin, Cuong Nguyen, Hijung Valentina Shin, Nikolas Martelaro

We developed a code-driven animated lyrics generation pipeline with a text-based interface for creative control.

Preprint Webpage Video

IUI '25

NoTeeline: Supporting Real-Time, Personalized Notetaking with LLM-Enhanced Micronotes

Faria Huq, Abdus Samee, David Chuan-En Lin, Xiaodi Alice Tang, Jeffrey Bigham

We built an interactive notetaking tool that lets users write quick keypoints while watching educational videos then automatically expands them into full notes.

Paper Video Code Cite

CHI '24

Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models

David Chuan-En Lin, Nikolas Martelaro

We developed a tool for combining AI models across different capabilities and modalities by combining them like puzzle pieces.

Webpage Paper Video Code Cite

C&C '24NeurIPS '22 ML4CD

VideoMap: Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Space

David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang, Nikolas Martelaro

We developed a proof-of-concept video editing interface that operates on video frames projected onto a latent space.

Webpage Full Paper Short Paper Video Cite

C&C '24NeurIPS '22 ML4CD

Videogenic: Identifying Highlight Moments in Videos with Professional Photographs as a Prior

David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang, Nikolas Martelaro

We developed a system for detecting highlight moments by leveraging photographs taken by photographers.

Webpage Full Paper Short Paper Video Cite

UIST '23NeurIPS '21 ML4CD

Soundify: Matching Sound Effects to Video

David Chuan-En Lin, Anastasis Germanidis, Cristóbal Valenzuela, Yining Shi, Nikolas Martelaro

We developed a system to assist video editors in adding content-aware spatial sound effects to video.

Webpage Full Paper Short Paper Talk Demo Code Cite

DIS '21

Learning Personal Style from Few Examples

David Chuan-En Lin, Nikolas Martelaro

We developed a model for learning personal graphic design style from a small handful of examples.

Webpage Paper Talk Cite

CHI '20

ARchitect: Building Interactive Virtual Experiences from Physical Affordances by Bringing Human-in-the-Loop

Chuan-En Lin*, Ta Ying Cheng*, Xiaojuan Ma(* = equal contribution)

We explored an asymmetric workflow of an AR builder and a VR player for creating VR experiences that incorporate real-world interaction affordances.

Webpage Paper Video Cite

EuroVis '20

SeqDynamics: Visual Analytics for Evaluating Online Problem-solving Dynamics

Meng Xia, Min Xu, Chuan-En Lin, Ta Ying Cheng, Huamin Qu, Xiaojuan Ma

We developed an interactive visual analytics system for instructors to evaluate problem-solving dynamics of student learners.

Paper Video Cite

CVPR '19

Learning to Film from Professional Human Motion Videos

Chong Huang, Chuan-En Lin, Zhenyu Yang, Yan Kong, Peng Chen, Xin Yang, Kwang-Ting Cheng

We developed an automatic drone cinematography system by learning from cinematic drone videos captured by professionals.

Paper Video Cite

Misc. Projects

Last updated on May 2025