Blog
We Built a Multi-Player Audio App With AI: Intro to Audiotool Nexus
Nexus is Audiotool's new extension layer that lets a browser-based app read and write a live project in real time, something a traditional VST can't do. Silas Gyger, lead engineer at Audiotool, shows how far an AI agent can take you by building three working apps from scratch.

News
We Built a Multi-Player Audio App With AI: Intro to Audiotool Nexus
Nexus is Audiotool's new extension layer that lets a browser-based app read and write a live project in real time, something a traditional VST can't do. Silas Gyger, lead engineer at Audiotool, shows how far an AI agent can take you by building three working apps from scratch.

We Built a Multi-Player Audio App With AI: Intro to Audiotool Nexus

We Built a Multi-Player Audio App With AI: Intro to Audiotool Nexus

Building your first Audiotool Nexus app, a browser-based extension that can read and write your entire project in real time, something a traditional VST simply can't do. Silas Gyger, lead engineer at Audiotool and author of the Nexus JS package, builds three apps live using nothing but an AI agent: a cable counter, a beat editor, and a Freesound sample browser.
More here: https://www.audiotool.com/LetsBuild/
Timestamps:
00:00 - Introduction & what is a Nexus app?
02:20 - The origin of Nexus: collaboration, validation & the AI revolution
09:33 - Getting started: all you need is an agentic coding tool
12:43 - Phase 1: building a cable counter (OAuth, scopes & the dev flow)
21:17 - Phase 2: building a beat editor & wiring the mixer
29:13 - Phase 3: a sample browser powered by the Freesound API
37:32 - Drag-and-drop: loading samples into Machinist
48:53 - Real-time collaboration & how Nexus differs from VST
51:52 - Wrap-up
Joshua Hodge
The Audio Programmer
More Tutorials


The Audio Programmer Virtual Meetup | April 9th, 2025 @ 17:00 UK
Jani Huoponen, Scott Kramer, and Claus Trelby explore Eclipsa Audio – Google and Samsung's open-source spatial audio format – and what it means for creators working across music, film, TV, and the open web.
More Meetups


The Audio Programmer Virtual Meetup | April 9th, 2025 @ 17:00 UK
Jani Huoponen, Scott Kramer, and Claus Trelby explore Eclipsa Audio – Google and Samsung's open-source spatial audio format – and what it means for creators working across music, film, TV, and the open web.
More News
More Articles


The audio industry is bigger than you think – and harder to hire into
Audio engineering has quietly fragmented across safety systems, embedded sensing, hearing tech and machine learning. The companies hiring in these fields are no longer just competing with other audio companies – and most of them don't realise it.









