Jump straight to the app

It can be hard work playing a musical instrument... So, how about letting the musical instrument play you instead?

Use your motions and emotions to make music! The original mood-controlled musical instrument! Learn more about the project or Show requirements.

This will grant musical superpowers to anybody nearby. Your head movements, facial expressions and mouth shape will control aspects of sound to help you make beautiful music. Press the screen or hold your eyes closed to change instruments, or select one by name from the side panels.
Improving human-machine relationships. Made with love by designerzen.

Warning : Please be very careful if you are photosensitive. Contains flashing lights.

Requirements
Requirements for compatibility :
Video Camera Web camera / phone camera Checking...
Speakers / HeadsetMake sure that the vvolume is not too quiet or mutedChecking...
MIDIOptional Electronic musical instrument with MIDI portsChecking...
Graphics Processing Unit GPUPowerful computer prefered, desktop or gaming machines wrk bestChecking...
Optimised Web Browser Not all features are available or are restricted in certain browsers.
Recommended browsers include Chrome / Edge
Alternate Browsers in terms of recommended features
  1. Chrome
  2. Edge
  3. Brave
  4. Arc
  5. Opera
  6. Vivaldi
  7. Safari
  8. Firefox
  9. Zen
Checking...

Emotionally Controlled Synthesizer

Use your moods to make music.

Loading please wait!

QR code linking to the PhotoSYNTH website

Share this app with friends

Choose Players
Options

Friendly version with simple interface and instuctions suitable for beginners =P

For Advanced users who want MIDI connectivity and many more controls

Please accept any permission requests

To use this software you must allow the camera to look at you, but no data leaves your device.

If you have MIDI instruments please also accept permission to communicate with them.

Change the instrument for each player to a random one

Shared controls that apply to all players

Show MIDI options
MIDI routing

Connect MIDI to configure each person.

MIDI monitor

No MIDI signals yet.

    Return to the control menu
    Show tempo options
    Set Tempo0%
    Return to the control menu
    Global settings and options

    Contact

    Questions, ideas or feedback?

    Get in touch (email [email protected])or for project news and future events.

    Powered by Mailchimp

    Hardware Integration

    Stream Deck (& XL)

    Stream Deck profiles

    Turn your Stream Deck into a PhotoSYNTH control surface for control instruments, visuals, drums and samples. Dedicated pages switch between note, chord, percussion and sample performance modes.

    Install the profile for your key layout to make PhotoSYNTH quicker to learn and easier to perform live, without memorising keyboard shortcuts.

    Download XL profile — 32 keysDownload standard profile — 15 keys
    Cosmo Dots

    Cosmo Dots

    Use your Cosmo Dots with the PhotoSYNTH to trigger notes, chords and samples!

    Set up each Dot so that it sends out a unique numerical number from 0-9.

    Supported by

    Representation

    Commands

    Search for a section, control, or action.

    ↑↓ NavigateEnter RunEsc Close

    Keyboard

    Select a sound mode, then press any key shown below to perform its labelled action.

    Sound modePgUp / PgDn change mode · Number keys always play Cosmo sounds

    Don't Panic!

    Load critical data
    Not working?

    If this seems to be stuck loading forever, please try the following

    1. Clear your browser's cache and hard refresh (ctrl-shift-r)
    2. Open the app in Private Browsing mode
    3. Try in a knwon supported Browser such as Chrome / Brave / Edge
    This is the Player Selection Screen

    Here we get to choose how many players will get to play!

    1. Select how many people will make music at the same time - one or two players
    2. Toggle the simple mode on for an easier to use version (kids mode)
    3. Click the Orange Start Button to continue
    Not working? Common Issues / Troubleshooting
    1. Camera was not granted permission by the browser
    2. Browser is too old / out of date try Chrome / Brave / Edge
    This is the Synthesizer

    It is controlled using your head

    Diagram explaining that head position and mouth control the key and amplitude
    Tilt your head
    Not working?
    Common Issues / Troubleshooting
    1. Camera was not allowed access
    2. Browser too old / out of date
    3. If your MIDI device is not found, try connecting it directly to a USB port, rather than through a hub or USB-C convertor
    4. If your face is not found, try and improve the brightness in the room by turning on some lights

    Still not working? Try resetting your options :

    Instructions

    Welcome to the PhotoSynth Smile at the screen FOR SUPER POWERS!

    Roll your head left and right to change the note Tilt your head forwards and backwards to change octave

    Then open you mouth to make it louder! Change instruments by closing both eyes for 1 bar or by tapping your face on screen to select an instrument from a list hold your finger on your face for one bar to see all instruments Facing left plays the black keys Facing right plays the white keys Use your eyes to shape the sound Connect a MIDI instrument and click the MIDI button In order to play the MIDI instrument with your head You can change tempo using the arrow keys Or just type a 3 digit number to set a BPM Or tap the x key in rhythm a few times

    Version 0.50.1

    Learn more from the YouTube Tutorials or the Online Documentation or try the tests Test Suite

    Realtime face controlled musical instrument!

    Install it to your device

    Updates available!
    Something went wrong

    PhotoSYNTH could not continue.

    Please try again.

    Camera help

    Technical details

    Select your MIDI device