Jump straight to the app

It can be hard work playing a musical instrument... So, how about letting the musical instrument play you instead?

Use your motions and emotions to make music! The original mood-controlled musical instrument! Learn more about the project or Show requirements.

This will grant musical superpowers to anybody nearby. Your head movements, facial expressions and mouth shape will control aspects of sound to help you make beautiful music. Press the screen or hold your eyes closed to change instruments, or select one by name from the side panels.
Improving human-machine relationships. Made with love by designerzen.

Warning : Please be very careful if you are photosensitive. Contains flashing lights.

Requirements
Requirements for compatibility :
Video Camera Web camera / phone camera Checking...
Speakers / HeadsetMake sure that the vvolume is not too quiet or mutedChecking...
MIDIOptional Electronic musical instrument with MIDI portsChecking...
Graphics Processing Unit GPUPowerful computer prefered, desktop or gaming machines wrk bestChecking...
Optimised Web Browser Not all features are available or are restricted in certain browsers.
Recommended browsers include Chrome / Edge
Alternate Browsers in terms of recommended features
  1. Chrome
  2. Edge
  3. Brave
  4. Arc
  5. Opera
  6. Vivaldi
  7. Safari
  8. Firefox
  9. Zen
Checking...

Augmented Reality Synthesizer

Loading please wait!

QR code linking to the PhotoSYNTH website

Share with friends

Choose Players
Options

Friendly version with simple interface and instuctions suitable for beginners =P

For Advanced users who want MIDI connectivity and many more controls

Please accept any permission requests

To use this software you must allow the camera to look at you, but no data leaves your device.

If you have MIDI instruments please also accept permission to communicate with them.

Change the instrument for each player to a random one

Shared controls that apply to all players

Show tempo options
Set Tempo0%
Return to the control menu
Global settings and options

Contact

Questions, ideas or feedback? Get in touch or join the newsletter for project news and future events.

Email [email protected]

Powered by Mailchimp

Stream Deck profiles

Turn your Stream Deck into a labelled PhotoSYNTH control surface for instruments, visuals, drums and samples. Dedicated pages switch between note, chord, percussion and sample performance modes.

Install the profile for your key layout to make PhotoSYNTH quicker to learn and easier to perform live, without memorising keyboard shortcuts.

Download XL profile — 32 keysDownload standard profile — 15 keys

Supported by

Representation

Commands

Search for a section, control, or action.

↑↓ NavigateEnter RunEsc Close

Don't Panic!

Load critical data
Not working?

If this seems to be stuck loading forever, please try the following

  1. Clear your browser's cache and hard refresh (ctrl-shift-r)
  2. Open the app in Private Browsing mode
  3. Try in a knwon supported Browser such as Chrome / Brave / Edge
This is the Player Selection Screen

Here we get to choose how many players will get to play!

  1. Select how many people will make music at the same time - one or two players
  2. Toggle the simple mode on for an easier to use version (kids mode)
  3. Click the Orange Start Button to continue
Not working? Common Issues / Troubleshooting
  1. Camera was not granted permission by the browser
  2. Browser is too old / out of date try Chrome / Brave / Edge
This is the Synthesizer

It is controlled using your head

Diagram explaining that head position and mouth control the key and amplitude
Tilt your head
Not working?
Common Issues / Troubleshooting
  1. Camera was not allowed access
  2. Browser too old / out of date
  3. If your MIDI device is not found, try connecting it directly to a USB port, rather than through a hub or USB-C convertor
  4. If your face is not found, try and improve the brightness in the room by turning on some lights

Still not working? Try resetting your options :

Instructions

Welcome to the PhotoSynth Smile at the screen FOR SUPER POWERS!

Roll your head left and right to change the note Tilt your head forwards and backwards to change octave

Then open you mouth to make it louder! Change instruments by closing both eyes for 1 bar or by tapping your face on screen to select an instrument from a list hold your finger on your face for one bar to see all instruments Facing left plays the black keys Facing right plays the white keys Use your eyes to shape the sound Connect a MIDI instrument and click the MIDI button In order to play the MIDI instrument with your head You can change tempo using the arrow keys Or just type a 3 digit number to set a BPM Or tap the x key in rhythm a few times

Version 0.49.10

Learn more from the YouTube Tutorials or the Online Documentation or try the tests Test Suite

Realtime face controlled musical instrument!

Install it to your device

Updates available!
Oh no! An error has occurred!

Hopefully this is a one time problem

Click the button to reload and try again

More information

Select your MIDI device