This research focuses on creating audio-visual web interaction inspired by the synesthetic experience. Synesthesia is a neurological condition where the processing of data by one sense activates others. This project hypothesizes that interactive digital artworks enable people to touch music, hear colours and expand their creativity and senses. They evoke synesthetic associations and activate certain senses’ vocabularies, and people start seeing a correlation between visual and audio experiences. This research explores the role of metaphor as a theoretical framework, conversational tool and design approach in the multimodal digital space. This project’s outcome is a web application that opens an empathic dialogue between people who experience synesthesia and those who are eager to learn what it is and what it is like to have it. Users can map their audio and visual senses’ associations by documenting and sharing them in the digital environment. This research applied research through design methodology by expanding the audience’s role from testing and observing to participating.

• https://canyouhearthedrawing-mariashirok...
• https://github.com/MariaShirokova/canyou...