Smile Powered Synthesizer

It's hard work learning how to play a musical instrument...
So, how about letting the musical instrument play you instead?.
Presenting, the original realtime face controlled musical instrument!

By granting your webcamera access, every movement of your face and mouth control all the sound aspects rquired to create music. Pressing the screen or holding your eyes closed will change instruments.

Improving human-machine relationships, made with love by designerzen.

Warning : Please be very careful if you are photosensitive. Contains flashing lights.

Jump straight to the app
Requirements
Play!
0%

Augmented Reality Synthesizer

Smile to begin!

How many people are going to participate?

Friendly version with simple interface and instuctions suitable for beginners =P

For Advanced users who want MIDI connectivity and many more controls

Shared controls that apply to all players
Global settings and options

Don't Panic!

Load critical data
Not working?

If this seems to be stuck loading forever, please try the following

  1. Clear your browser's cache and hard refresh (ctrl-shift-r)
  2. Open the app in Private Browsing mode
  3. Try in a knwon supported Browser such as Chrome / Brave / Edge
This is the Player Selection Screen

Here we get to choose how many players will get to play!

  1. Select how many people will make music at the same time - one or two players
  2. Toggle the simple mode on for an easier to use version (kids mode)
  3. Click the Orange Start Button to continue
Not working? Common Issues / Troubleshooting
  1. Camera was not granted permission by the browser
  2. Browser is too old / out of date try Chrome / Brave / Edge
This is the Synthesizer

It is controlled using your head

Diagram explaining that head position and mouth control the key and amplitude
Tilt your head
Not working?
Common Issues / Troubleshooting
  1. Camera was not allowed access
  2. Browser too old / out of date
  3. If your MIDI device is not found, try connecting it directly to a USB port, rather than through a hub or USB-C convertor
  4. If your face is not found, try and improve the brightness in the room by turning on some lights

Still not working? Try resetting your options :

Instructions

Welcome to the PhotoSynth Smile at the screen FOR SUPER POWERS!

Roll your head left and right to change the note Tilt your head forwards and backwards to change octave

Then open you mouth to make it louder! Change instruments by closing both eyes for 1 bar or by tapping your face on screen to select an instrument from a list hold your finger on your face for one bar to see all instruments Facing left plays the black keys Facing right plays the white keys Use your eyes to shape the sound Connect a MIDI instrument and click the MIDI button In order to play the MIDI instrument with your head You can change tempo using the arrow keys Or just type a 3 digit number to set a BPM Or tap the x key in rhythm a few times

Version 0.20.1

Learn more from the YouTube Tutorials or the Online Documentation

Realtime face controlled musical instrument!

Install it to your device

Updates available!
Oh no! An error has occurred!

Hopefully this is a one time problem

Click the button to reload and try again

More information