Exploration of Trans-Sensory Mappings

The paper explores the way music can be translated into a sequence of images. A general approach is described that associates various structures captured by different sense modalities. The approach is illustrated by examples from vision and audition. Music and sets of images are digitalized and represented as forms in multidimensional spaces. A mapping, which preserves the dissimilarities in each space is then defined and an algorithm that can approximate the optimal fit is proposed. An example that maps a set of photos of different versions of the wire chair on various Mozart variations is given.