This webapp was coded with LLM assistance.
Video keynote address to the Third Summit on Music Intelligence
Sonification is the translation of data to sound and music. My video presents examples for scientific and artistic purposes that use “musical listening” to make a connection to trends in the data. Webapps provide a ubitquitous way of distributing live sonifications and can be easily programmed with text prompts input to LLM’s. The video demonstrates a workflow I’ve been using in workshops for scientists and musicians interested in creating their own sonifications.
The prompt was
Provide as an artifact a standalone all-in-one HTML plus JavaScript page that uses the web audio API running at 48 kHz to sonify the entire time series of the global CO2 data record collected from the Mauna Loa Observatory. Download the data direct from the NOAA site. Use a simple continuous FM tone updating its frequency modulation index and amplitude with the downloaded time series for smoothness. These updates should call exponentialRampToValueAtTime(). Include a start-stop button that starts playback from the beginning through the end of the data or stops the sound and resets playback to the start of the data. Provide a slider that adjusts update rate between 50 milliseconds and 1 millisecond and applies the changes in real time while playing. Provide a responsive visual graph of the data
The webapp demo and video were first presented to the Third Summit on Music Intelligence at the Central Conservatory of Music in Beijing 25-26 April 2026 (news post)