Projects

I build machine learning systems and tools for exploring the physical world—from generative motion and sensing to electromagnetic and neural simulation.

Recent open source · Research projects · Scientific tools

Recent open-source projects

A simulated fruit fly driving through a city alongside a live 3D view of neural activity.

2026 Interactive simulation

Flybrain Drive

A real-time 3D driving experiment coupling a fruit-fly connectome subgraph to simplified spiking neurons, interactive traffic, and live neural activity.

Engineered sensing and control; the model has not been trained to drive.

OpenEM project graphic with an illustrative wave and simulation grid.

2026 Scientific computing

OpenEM

A CUDA FDTD solver that runs Tidy3D Simulation objects on a local NVIDIA GPU, built for differential validation against the reference solver.

Single-GPU, fp32 time stepping; grid and material generation come from the Tidy3D client.

Research projects

T2M-X: Expressive text-to-motion generation

2023 · Snap Research internship

Generating expressive avatars requires coordinated body, hand, and facial motion, while available datasets often annotate only some of these components. T2M-X learns from partially annotated data using separate VQ-VAE experts for each component and a multi-indexing GPT with a motion consistency loss. The model combines these representations to generate coordinated whole-body motion from text.

Paper · Appendix · Demo

Comparison of body-only motion generation and expressive motion including hands and face.
From body motion to expressive whole-body animation.
View model architecture
T2M-X architecture with separate body, hand, and face VQ-VAE experts, a multi-indexing GPT, and a shared consistency space.
Specialized motion representations coordinated through a multi-indexing GPT.

Text-guided music-to-dance generation

2022 · Amazon Alexa AI internship

This project generates dance motion conditioned on music while allowing text-based edits such as “move your right arm up.” Motion and text are mapped into a shared latent space, with a motion codebook conditioned on music features—including genre, spectrograms, and tempo—to produce and edit avatar movements.

Demo · Slides

Animated demonstration of dance motion generated from music and text guidance.
Dance generation conditioned on music and text guidance.
View model diagrams
Diagram of the text-guided music-to-dance generation model.
Additional architecture diagram for music-conditioned dance generation.

Smartwatch-based hand gesture recognition for AR glasses

2021 · OPPO US Research Center internship

A wrist-worn gesture recognition system using inertial measurement unit (IMU) and photoplethysmography (PPG) signals, enabling interaction beyond a camera’s field of view. A modified MobileNet trained on 0.4 million samples achieved average recall of 96% and precision of 94% across gesture types. Incorporating handcrafted signal features reduced power consumption by 35% relative to the compared methods.

Demo · Patent · Yahoo coverage · Nomtek coverage · TNW coverage

View gesture recognition results
Results table for the smartwatch-based hand gesture recognition model.

Indoor activity recognition with mmWave radar

Computer Science master's thesis · Iowa State University

A human activity recognition system for aging in place using mmWave radar instead of RGB cameras. Four deep learning models were compared, with the best model reaching 91.87% test accuracy. The prototype connects Raspberry Pi devices to AWS IoT for data collection and processing, with an AWS Lambda threshold for fall alerts.

Project website · Demo · Presentation · Code

View system diagrams
Overview of the mmWave radar indoor activity recognition system.
Processing and deployment diagram for radar-based indoor activity recognition.

Intelligent antenna design with generative adversarial networks

AI for electromagnetics · AntennaGAN

A GAN-based approach to designing dielectric resonator antennas for the 60 GHz band. A simulator learns the relationship between antenna geometry and the S11 response, while a generator proposes geometric patterns conditioned on a target S11 spectrum. The system reduces reliance on manual trial-and-error design.

Paper · Code

AntennaGAN architecture showing the generator, simulator, and critic networks conditioned on an S11 spectrum.
The generator proposes antenna patterns from a target S11 spectrum and noise; simulator and critic networks guide training.

Scientific tools