Skip to content

Live lab — sound × image

20 instruments · one console · patch cables · nothing leaves the browser

Instruments.

Twenty playable machines and one performance deck. Every rhythmic instrument locks to a master clock, every melodic one shares a key, and the low end sidechains the whole mix — press Play all in the deck below and layer the room like a live set. The last five tune the brain's own frequencies: binaural entrainment across the EEG bands, an MRI Larmor synth, a Kuramoto cortex that self-synchronizes, the planet's Schumann resonance and a gravity-tuned pendulum wave — the last two answer to your phone's motion. Every voice is synthesized in your browser; knobs and fingers work in real time; uploads never leave your device. Each machine has its own channel strip — level, FX send, mute, solo — and the Console at the bottom is a patch bay: cable any instrument into another to sidechain it, or into the master effects, Reason-style.

Instruments20
SynthesisWeb Audio
UploadsLocal only
01

STEP·GRID

8×4 mosaic sequencer · synthesized 808 voices
BPM
Swing
Crush
img: sketchbook
Mix
Level
Send

The picture is the drum machine. Every tile is one step of one voice — tap or drag-paint tiles with as many fingers as you have, and the playhead sweeps the mosaic while each hit flashes its piece of the image. Kicks carry an 808 sub underneath: feel it in headphones.

02

ACID·16

16-slice 303 · saw → envelope filter → drive
Cutoff
Reso
Drive
img: sketchbook
Mix
Level
Send

The picture is the bassline. Each vertical slice is one sixteenth-note — drag up and down across the slices to write the melody (slices ride like piano-roll keys), then let the acid line squelch. Mutate breeds a new pattern; amber ticks are accents.

03

ORBIT

generative arpeggiator · 2-saw Moog voice → echo
Root
Echo
Drift
img: sketchbook
Mix
Level
Send

Orbs circle a center and a sweeping ray plucks each one's note as it passes. Tap anywhere to add an orb on that orbit (eight max — the oldest falls away). Move the cursor to bend the filter live: left–right is cutoff, up–down is resonance. The picture spins underneath as a slow feedback nebula.

04

AIM·PAD

pads + stroke theremin · live waveform strokes
Tone
Rate
Prism
img: sketchbook
Mix
Level
Send

The wordmark as a playable surface. Hold a glyph's open space for its voice — A drone, I arp, M shimmer, chords with multiple fingers, Tone and Rate live. Or trace the lines themselves: a glide voice rides your finger along the stroke — the A is a fretless sub-bass neck, the I a mid slide, the M sings on top — with the line vibrating under your touch, sparks, ripples, and a live note readout. Mouse hovers play without clicking.

05

JULIA

escape-time fractal shader · critical-orbit sonification
c = −0.720 + 0.190i · period 1
Zoom
Blend
Tempo
img: sketchbook
Mix
Level
Send

The Julia set of z → z² + c, computed live in a shader, with your cursor steering c. The picture is sampled through the iteration field, so the photo becomes the fractal. The melody is the same equation: a clock iterates the critical orbit and plays each point — an attracting period-3 cycle plays a 3-note loop, chaos wanders, escape rises and dies.

06

LATTICE

Verlet spring–mass membrane · Karplus–Strong strings
Tension
Damping
Tune
img: sketchbook
Mix
Level
Send

Pluck the picture. The image rides a spring–mass membrane integrated with Verlet dynamics — drag through it and the ripple propagates by real physics, springs glowing where they stretch. Every pluck also strikes a Karplus–Strong string (a noise burst circulating a damped delay line — the physics of a plucked string, computed live): row picks the note, drag speed the velocity.

07

DELTA

Sierpiński gasket sequencer · FM bells + 808 sub
Depth
BPM
FM
img: sketchbook
Mix
Level
Send

The A of the wordmark subdivided into a Sierpiński gasket — self-similar geometry as a self-similar melody. Every small triangle is a step: arm them with taps (any number of fingers), and the sweeping playhead rings an FM bell per cell, pitched by height, colored by depth. Quarter-note 808 subs keep the floor moving. Depth re-cuts the fractal live.

08

REEL

the showreel as vinyl · synthesized scratch + tape stop
Trails
Tone
Motor
img: sketchbook
Mix
Level
Send

The AIM showreel on a turntable. Drag left and right to scratch — the film scrubs under your finger while a pitch-bent motor tone and vinyl noise are synthesized from your gesture, and the frame smears into RGB-split echo trails. Motor spins the reel on its own; Tape stop kills it with a dive. Trails, Tone and Motor respond live. If the reel can't load, a sketchbook frame stands in so it still plays.

09

CHOIR

formant vocal synthesis · no microphone
Blend
Air
Spread
img: sketchbook
Mix
Level
Send

The letters sing. Each glyph is a synthetic voice — sawtooth and sub through three bandpass filters parked at real vowel formants. Hold A for 'ah', I for 'ee', M for a hum; drag while holding to morph the vowel left–right and bend pitch up–down, Kaoss-pad style, with full multi-touch chords. The picture smears into spectral columns driven by the choir's live spectrum.

10

TETRA

three.js rigid tumble · collision percussion
Gravity
Bounce
Pitch
img: sketchbook
Mix
Level
Send

The triangle goes three-dimensional: hairline tetrahedra tumble in a glass box, and every collision — wall or body — strikes a velocity-scaled percussive ping pitched by the body's size. The physics plays itself. Move the cursor to tilt gravity, tap to slam an impulse through the box; the picture lines the floor. Small bodies ring high, big ones knock low.

11

CONSTELLA

constellation tour sequencer · geometry = rhythm
Speed
Gravity
Bright
img: sketchbook
Mix
Level
Send

Draw a constellation, hear its circuit. Tap to place stars — hold for heavier ones — and a comet solves a nearest-neighbour tour through your sky and walks it forever: star height is pitch, star mass picks the voice (light stars pluck, heavy stars ring FM bells), and the distance between stars is literally the rest between notes. Your drawing is the score.

12

RORSCHACH

mirrored ink · additive resynthesis of the blot
Turb
Root
Glow
img: sketchbook
Mix
Level
Send

Sculpt smoke, hear its spectrum. The inkblot's horizontal density is read as a 16-band profile and resynthesized live by sixteen sine partials over one fundamental — push ink into a region and that harmonic swells, blow it apart and the timbre hollows. You are painting a sound. Drone starts with Sound on; Turbulence stirs the blot, Root tunes the fundamental.

13

DOPPLER

f = f₀·c/(c−v) · flingable drone, wall knocks
Pitch
Drag
Bounce
img: sketchbook
Mix
Level
Send

Fling a sound and let physics detune it. The comet carries a drone; the pitch you hear is the actual Doppler formula computed against the listener triangle at the center — sharpening as it rushes in, flattening as it recedes — with distance fading, stereo position panning, and wall bounces knocking. The readout shows radial velocity, distance and the live frequency ratio.

14

LOOM

image sonification weaving · brightness = pitch
Tempo
Weave
Tone
img: sketchbook
Mix
Level
Send

Weave the picture into music. The image hangs as forty-eight warp threads; draw a path across them and a shuttle runs your line, playing every thread it crosses at the pitch of the image's brightness under that exact point — highlights ring high, shadows land low. Each weft stays woven into the cloth, visibly bending the warp: the picture gradually becomes a textile of everything you've played.

15

BIGBANG

n-body gravity · mergers are drum hits
Gravity
Hubble
Pitch
img: sketchbook
Mix
Level
Send

Play the formation of galaxies. Bang shatters the picture into ninety shards blasted from the center; pairwise gravity pulls the debris back, and every merger strikes a bass impact scaled by the combined mass — grains tick, galaxies boom, and the soundtrack is literally structure formation collapsing chaos into rhythm. Hubble stretches space against the collapse; tap anywhere for a local bang.

Brain frequencies.

Five instruments tuned to the rhythms neuroscience measures — Delta through Gamma, the Larmor precession that builds an MRI, the coupled-oscillator sync behind a brainwave, and the planet's own resonance near the edge of alpha. Every number on screen is real and measured; every effect is your own. These are instruments, not therapies — headphones make the binaural beats audible, and on a phone the last two react to how you move it.

16

ENTRAIN

binaural / isochronic · the EEG spectrum, audible
Carrier
Beat
Depth
img: sketchbook
Mix
Level
Send

The brainwave entrainment engine. Two pure tones a few hertz apart — one steered to each ear — and your brain manufactures the difference as a phantom beat that pulses at exactly that many hertz. Drag across the EEG ruler from Delta (deep sleep) to Gamma (peak cognition) and the picture breathes in time, so you can see the frequency your ears are being handed. Binaural wants headphones; Isochronic gates one tone on and off and plays on anything. An instrument for feeling what a frequency is — not a medical device.

17

LARMOR

NMR precession · f = γB · dephasing = detune, decay = T2
Field
T2
Gradient
img: sketchbook
Mix
Level
Send

Play an MRI. A magnetic field sets every proton precessing at its Larmor frequency — 63.9 MHz at 1.5 tesla, far above hearing — and an RF pulse tuned to it tips the spins sideways in phase, so they ring one pure tone: the free-induction decay. A gradient then makes each region precess a hair differently, the tone smears into a beating chorus, and it fades over T2. Raise the field and the whole pitch transposes up by octaves, because the only cheat is one fixed divisor from megahertz down to sound.

18

CORTEX

Kuramoto synchronization · coherence r is the wave
Band
Coupling
Spread
img: sketchbook
Mix
Level
Send

Watch a brainwave assemble itself. Sixty oscillators each tick at their own rate until Coupling makes them phase-lock by the Kuramoto rule — and their coherence r, climbing from noise to one rhythm, is exactly what a brainwave is: a population beating together, not a single neuron. You hear the emergence, a hush at low coherence swelling to a pulse at the chosen band, so a 40 Hz gamma lock becomes an audible buzz. Tap to fire an excitatory TMS pulse; Inhibit scatters the phases so you can hear the network re-synchronize.

19

SCHUMANN

Earth–ionosphere cavity · 7.83 Hz + harmonics · motion-reactive
Cavity Q
Charge
Drive
img: sketchbook
Mix
Level
Send

Play the planet's own frequency. The cavity between the ground and the ionosphere rings at ~7.83 Hz and up — the fundamental landing, by coincidence, right at the edge of human alpha rhythm — struck endlessly by global lightning. It's too low to hear, so the whole stack is lifted into the bass and each harmonic rings like a struck bell. Shake your phone to throw lightning into the cavity and tilt it to pour energy between the modes; on a desktop, drag and click do the same. A coincidence we find beautiful, not a mechanism.

20

PENDULA

pendulum wave · tilt is gravity · f ∝ √g · motion-reactive
Tempo
Span
Tone
img: sketchbook
Mix
Level
Send

Gravity retunes the rhythm. Twelve pendulums, each slightly longer than the last, fan their swing rates across the slow-wave range and — released together — drift out of step and back, the travelling pendulum wave, each bob ringing a note as it crosses bottom so the pattern plays itself as an arpeggio. The physics is honest: a pendulum's rate goes as the square root of gravity, so tilting your phone changes the effective g and the whole chord glissandos while the rack leans. Shake to release them again; on a desktop, drag to tilt.

The console.

Master filter, echo, space and FX mix, plus a patch constellation. Tap any instrument node then another to run a cable: instrument to instrument sidechains the target, so a kick can duck the pads; instrument to an effect lets its live level drive it. The cables glow with the signal passing through them.

CONSOLE

master FX · patch constellation
Master
Volume
Filter
Echo
Space
FX mix

The master section and a patch bay in one. Set the master filter, echo, space and FX mix; then wire the constellation — tap any instrument node, then another, to run a cable. Instrument → instrument sidechains (the source ducks the target, so patch a kick into the pads and they breathe); instrument → FILTER/ECHO/SPACE/MIX lets its live level drive that effect. Cables glow with the signal actually passing through them. Nothing here leaves your browser.

Headphones recommended — required for true binaural beats · on a phone, Schumann and Pendula react to motion · every instrument has its own channel strip; the Console patches them together · all synthesis runs on your device · the deck below locks every instrument to one clock and one key · instruments, not therapies

124 bpm
key +0