How to use See Different:
As a game, "See Different" can be used to find basic objects or friends by using sounds without vision (blind mans buff - "Colin-maillard").
As a creation tool, "See Different" can be used to "compose" simple melodies.
"See Different" can also be a good coach to train people to locate sounds in a 2D auditory sound scene (2D soundscape).
Headsets to be connected on the audio jack of the device should be used to perceive the 2D sound effects.
How it works:
"See Different" searches for area of interest into the images and maps green squares on the screen and plays sounds corresponding to the position of the area of interests. For example, a sound is heard as coming from the upper left when the area of interest inside the video image - associated to that sound - is also in the upper left portion of the image.
What is See Different:
"See Different" is an implementation and a simplification of a sensory substitution system that maps a visual scene into a 2D audible scene. The mapping is done after analysis of the image snapshots taken from the video output of the camera. Sounds are synthesized in such way that location of sound sources is perceived in a virtual acoustical space by exploitation of the Intensity Level Differences (ILD), the Interaural Time differences (ITD) and the spectral characteristics of Head Related Transfer functions (HRTF).
Contact for feedbacks : [email protected]