OCAD University Open Research Repository

Can You Hear Your Drawing? Creating synesthetic experiences through an audio-visual web interaction

Shirokova, Maria (2021) Can You Hear Your Drawing? Creating synesthetic experiences through an audio-visual web interaction. Masters thesis, OCAD University.

Item Type: Thesis
Creators: Shirokova, Maria
Abstract:

This research focuses on creating audio-visual web interaction inspired by the synesthetic experience. Synesthesia is a neurological condition where the processing of data by one sense activates others. This project hypothesizes that interactive digital artworks enable people to touch music, hear colours and expand their creativity and senses. They evoke synesthetic associations and activate certain senses’ vocabularies, and people start seeing a correlation between visual and audio experiences. This research explores the role of metaphor as a theoretical framework, conversational tool and design approach in the multimodal digital space. This project’s outcome is a web application that opens an empathic dialogue between people who experience synesthesia and those who are eager to learn what it is and what it is like to have it. Users can map their audio and visual senses’ associations by documenting and sharing them in the digital environment. This research applied research through design methodology by expanding the audience’s role from testing and observing to participating.

Official URL: http://canyouhearyourdrawing.app/
Date: 18 March 2021
Uncontrolled Keywords: interaction design, multimodality, multi-sensory interface, colour music, exploratory creativity, synesthesia, chromesthesia, audio-visual web application, conversational tool, apparatus, metaphor
Divisions: Graduate Studies > Digital Futures
Related URLs:
Date Deposited: 06 May 2021 20:40
Last Modified: 02 Aug 2021 08:47
URI: http://openresearch.ocadu.ca/id/eprint/3330

Actions (login required)

Edit View Edit View