LOADING...

SEBASTIAN
MONZÓN.

Building multimodal AI and embedded systems that transform human signals into sound and insight.

Sebastian Monzón

I'm a Harvard MDE candidate, MIT research affiliate, and NSF CSGrad4US fellowship awardee building multimodal AI and embedded systems that transform human signals into sound and insight. I explore expressive interfaces, wireless sensing wearables, and material-optimizing frameworks. Ex-SWE at Cisco Meraki.

Education
UMass Amherst BS in CS'19-'23
Research
MIT Research Affiliate
Media Lab · Dept. of Mechanical Engineering
SKILLS & TECHNOLOGIES

I'm constantly looking to solve problems with what I know, and searching for opportunities to learn what I don't.

SoftwareHTML, CSS, & JavaScriptPythonC/C++Node/React JSRuby on RailsMatlab
Hardware & DesignKiCADFusion 360
CreativeAbleton LiveAdobe Suite
Coded by me on GitHub and CodePen.

RESEARCH

View all →
SwimSense is a wireless, wearable, waterproof device equipped with IMU, PPG, and temperature sensor for realtime health sensing and reporting for aquatic environments. Originally as a research collaboration with MIT Media Lab and Dept. of Mechanical Engineering, I am now independently developing SwimSense to improve comfort, battery life, and data quality. The device aims to provide swimmers and coaches with detailed insights into performance and physiological metrics during training. I also plan on adapting this device to other extreme environments where low energy, long range health monitoring is critical.
2025

SwimSense: Computational Sensing for Swimming Analysis (in-progress)

SwimSense is a wireless, wearable, waterproof device equipped with IMU, PPG, and temperature sensor for realtime health sensing and reporting for aquatic environments. Originally as a research collaboration with MIT Media Lab and Dept. of Mechanical Engineering, I am now independently developing SwimSense to improve comfort, battery life, and data quality. The device aims to provide swimmers and coaches with detailed insights into performance and physiological metrics during training. I also plan on adapting this device to other extreme environments where low energy, long range health monitoring is critical.

An ongoing independent research project that uses a variational autoencoder to generate percussive audio from hand gestures. The model builds upon RAVE, a state-of-the-art neural audio synthesis architecture, and trains on high-frame-rate recordings of conga drum performances (played by my dad) to capture fine hand movements. The goal is to make it possible to play any percussive instrument using only hand gestures and a camera.
2025

MAGE: Motion-to-Audio Generative autoEncoder (in-progress)

An ongoing independent research project that uses a variational autoencoder to generate percussive audio from hand gestures. The model builds upon RAVE, a state-of-the-art neural audio synthesis architecture, and trains on high-frame-rate recordings of conga drum performances (played by my dad) to capture fine hand movements. The goal is to make it possible to play any percussive instrument using only hand gestures and a camera.

In collaboration with researchers at the MIT Department of Mechanical Engineering and Media Lab, I developed a Stable Diffusion-based pipeline (inspired by Riffusion) for Mel-spectrogram inpainting. The model reconstructs masked audio regions, keeping optimal frequencies intact. I am currently experimenting with CLIP soft tokens to directly generate improved hydrogel music without inpainting and an audio equalizer I designed based on band performance correlations and SHAP analysis.
2025

Music-Spectrogram Inpainting for Hydrogel Dewatering (in-progress)

In collaboration with researchers at the MIT Department of Mechanical Engineering and Media Lab, I developed a Stable Diffusion-based pipeline (inspired by Riffusion) for Mel-spectrogram inpainting. The model reconstructs masked audio regions, keeping optimal frequencies intact. I am currently experimenting with CLIP soft tokens to directly generate improved hydrogel music without inpainting and an audio equalizer I designed based on band performance correlations and SHAP analysis.

PROJECTS

View all →
FeaturedPortfolio Video · 2025
ENGINEERRESEARCHERDESIGNERMUSICIANENGINEERRESEARCHERDESIGNERMUSICIANENGINEERRESEARCHERDESIGNERMUSICIANENGINEERRESEARCHERDESIGNERMUSICIAN