0%

Augmented Reality Drum Sequencer

Loading please wait!

Choose Players
Options

Friendly version with simple interface and instuctions suitable for beginners =P

Expert mode includes MIDI connectivity and more controls

Please accept any permission requests

To use this software you must allow the camera to look at you, but no data leaves your device.

If you have MIDI instruments please also accept permission to communicate with them.

Change the instrument for each player to a random one

Shared controls that apply to all players

Show MIDI options

MIDI routing

MIDI routing

Connected MIDI devices

Connect MIDI devices - zero devices found.

Eyebrow expression

Enable Eyebrow expression in each person's instrument settings. Output follows that person's MIDI device and channel. CC values span 0–127 with relaxed eyebrows at 64; pitch bend centres at 0.

MIDI app controls

Use values 0–63 for off and 64–127 for on. Faders span their full range. Selectors span their options in order. Changes send CC to all connected outputs on this channel.

Scroll to explore connections and settings
Show tempo options
Set Tempo0%
Return to the control menu
VolumeMixer
VolumeMixer
Master
0%
Beats
0%
Melody
25%
SFX
0%
Person Trim
267%
Return to the control menu
Engine
Engine

One voice engine plays all players. Percussion has its own engine.

Loudness

Engine levels are balanced by default. This extra gain is saved separately for each engine and applies to all players. Lower it if chords distort.

SoundFont
App reverb

Every player also sends to this room, on top of their instrument reverb. Ensembles can choose it.

App reverb follows mouth expression so its tail continues after the sound stops.

Applies to all players. Percussion uses its own engine.

Return to the control menu
Mouth
Mouth dynamics

How opening your mouth turns into loudness for all players. Adjust while playing to find what works best.

Loudness curve. Opening runs left to right, loudness bottom to top.

Drag a handle to reshape the curve. Click the graph to add a handle; double-click a handle or press Delete to remove it. Arrow keys move the focused handle. A flat start gives more room for quiet notes.

Opening

How far the mouth must open before a note starts. Lower values trigger notes sooner.

How much opening the whole curve covers. Short reaches full volume with less movement; long gives more room for quiet playing.

Return to the control menu
Head
Head movement

How far every player moves their head to reach each note and octave. The faces show how much travel each setting asks for.

How far the head leans side to side to cross every note. Lower needs less movement.

Nod
90°How far the head nods up and down to cross every octave. Lower needs less movement.
Centre
+10°The head height that plays the middle octave. Raise it so looking ahead plays lower octaves and the top octave needs a higher head.
Return to the control menu

MIDI CC controls

PhotoSYNTH app assignments. Enable MIDI and two-way CC control, then send Control Change messages on app control channel 16. Changes also send to connected outputs.

CC numbers and values are decimal (0–127). Switches: 0–63 off, 64–127 on. Faders: 0 = minimum, 127 = maximum. Selectors: options are evenly spaced from 0 to 127, in the order shown.

All supported app CC assignments
CCControlValues / mapping

Commands

Search for a section, control, or action.

↑↓ NavigateEnter RunEsc Close

Keyboard

Select a sound mode, then press any key shown below to perform its labelled action.

Sound modePgUp / PgDn change mode · Number keys always play Cosmo sounds

How to play PhotoSYNTH

Make music with your face and head movements, using your device’s camera.

Get started
  1. Choose the number of players on the start screen, then select Start.
  2. Allow camera access when your browser asks, and position your face in view of the camera.
  3. Roll your head left and right to change the note. Tilt forwards and backwards to change the octave.
  4. Open your mouth to make the sound louder. Try small movements first.
  5. Tap your face on screen to choose an instrument. Explore the control panel to adjust the sound, tempo, and volume.
If something is not working
Learn more and get help
Version 0.60.5
Realtime face controlled musical instrument!

Install it to your device

Updates available!
Something went wrong

PhotoSYNTH could not continue.

Please try again.

Camera help

Technical details

Select your MIDI device