Web-based research on cross-modal correspondences between colour and sound.

Abstract

Cross-modal correspondences between colour and sound or sound and colour are the basis for the colour sonification methods used in some categories of sensory substitution devices or sensory substitution software. This Master Thesis explores sonification methods, sensory substitution devices and software, dedicating particular interest to how the cross-modal correspondences can be researched through controlled laboratory study, Virtual Reality or web-based research. The advantages and disadvantages of Web-based researches are analysed in the delicate context of psychophysiological studies. The study presents interesting results regarding the connection between sound frequency and hue, saturation and lightness, gives recommendation about further research in cross-modal correspondences, comments on the state of Web APIs and Web Audio API in a psychophysiological research context, gives an overview of modern web-based technologies (such as Vue.js, Tone.js, Firebase) and their use in psychophysical studies.