Navegar

Colección

Datos Estadísticas

Artículo

Estamos trabajando para incorporar este artículo al repositorio
Consulte la política de Acceso Abierto del editor

Abstract:

While there is broad consensus about the structural similarities between language and music, comparably less attention has been devoted to semantic correspondences between these two ubiquitous manifestations of human culture. We have investigated the relations between music and a narrow and bounded domain of semantics: the words and concepts referring to taste sensations. In a recent work, we found that taste words were consistently mapped to musical parameters. Bitter is associated with low-pitched and continuous music (legato), salty is characterized by silences between notes (staccato), sour is high pitched, dissonant and fast and sweet is consonant, slow and soft (Mesz et al., 2011). Here we extended these ideas, in a synergistic dialog between music and science, investigating whether music can be algorithmically generated from taste-words. We developed and implemented an algorithm that exploits a large corpus of classic and popular songs. New musical pieces were produced by choosing fragments from the corpus and modifying them to minimize their distance to the region in musical space that characterizes each taste. In order to test the capability of the produced music to elicit significant associations with the different tastes, musical pieces were produced and judged by a group of non-musicians. Results showed that participants could decode well above chance the taste-word of the composition. We also discuss how our findings can be expressed in a performance bridging music and cognitive science. © 2012 Mesz, Sigman and Trevisan.

Registro:

Documento: Artículo
Título:A composition algorithm based on cross modal taste-music correspondences
Autor:Mesz, B.; Sigman, M.; Trevisan, M.A.
Filiación:Departamento de Ciencia y Tecnología, Universidad Nacional de Quilmes, Bernal, Buenos Aires, Argentina
Laboratory of Integrative Neuroscience, Physics Department, FCEN, University of Buenos Aires, Ciudad Universitaria, Buenos Aires, Argentina
Laboratory of Dynamical Systems, IFIBA-Physics Department, FCEN, University of Buenos Aires, Ciudad Universitaria, Buenos Aires, Argentina
Palabras clave:Cross-modal associations; Music; Musical algorithm; Semantics; Taste; adult; algorithm; article; auditory discrimination; auditory memory; auditory response; female; human; human experiment; language ability; male; Monte Carlo method; music; semantics; sensory analysis; sensory feedback; sound analysis; stimulus response; task performance; taste discrimination
Año:2012
Número:APRIL 2012
Título revista:Frontiers in Human Neuroscience
Título revista abreviado:Front. Human Neurosci.
ISSN:16625161
Registro:https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_16625161_v_nAPRIL2012_p_Mesz

Referencias:

  • http://www.speech.kth.se/music/5_lectures/askenflt/askenflt.html, Askenfelt; http://zztt.org/en/onkimi, Azzigotti; Beeli, G., Esslen, M., Jänke, L., Synaesthesia: When coloured sounds taste sweet (2005) Nature, 434, p. 38
  • Bradley, M.M., Lang, P.J., (1999) Affective Norms For English Words (ANEW): Instruction Manual and Affective Ratings, Technical Report C-1, , The Center for Research in Psychophysiology, University of Florida
  • http://homepage.mac.com/cariani/CarianiNewWebsite/Publications_files/Car iani-ICMPC-8-2004-Proceedings.pdf, Cariani; Chomsky, N., (1988) Language and Problems of Language, , Cambridge, MA: MIT Press
  • Crisinel, A.-S., Cosser, S., King, S., Jones, R., Petrie, J., Spence, C., A bittersweet symphony: Systematically modulating the taste of food by changing the sonic properties of the soundtrack playing in the background (2011) Food Qual. Prefer, 24, pp. 201-204
  • Crisinel, A.S., Spence, C., Implicit association between basic tastes and pitch (2009) Neurosci. Lett, 464, pp. 39-42
  • Crisinel, A.S., Spence, C., As bitter as a trombone: Synesthetic correspondences in nonsynesthetes between tastes/flavors and musical notes (2010) Atten. Percept. Psychophys, 72, pp. 1994-2002
  • Crisinel, A.S., Spence, C., A sweet sound? Food names reveal implicit associations between taste and pitch (2010) Perception, 39, pp. 417-425
  • Debussy, C., (1913) Préludes, , http://imslp.org/wiki/Preludes_(Book_2)_(Debussy,_Claude, Book 2: III
  • Driver, J., Spence, C., Multisensory perception: Beyond modularity and convergence (2000) Curr. Biol, 10, pp. R731-R735
  • http://www.peachnote.com, Engine; Evans, K.K., Treisman, A., Natural cross-modal mappings between visual and auditory features (2010) J. Vis, 10 (6), pp. 1-12
  • Fastl, H., Zwicker, E., (2007) Psychoacoustics. Facts and Models, , Berlin: Springer
  • Fraisse, P., Rhythm and tempo (1982) Psychology of Music, pp. 149-180. , ed D. Deutsch (New York, NY: Academic
  • Hänggi, J., Beeli, G., Oechslin, M.S., Jaencke, L., The multiple synaesthete E.S.: Neuroanatomi-cal basis of interval-taste and tone-colour synaesthesia (2008) Neuroimage, 43, pp. 192-203
  • Jackendoff, R., Lerdahl, F., The capacity for music: What is it, and what's special about it? (2006) Cognition, 100, pp. 33-72
  • Jentschke, S., Koelsch, S., Friederici, A.D., Investigating the relationship of music and language in children: Influences of musical training and language impairment (2005) Ann. N.Y. Acad. Sci, 1060, pp. 231-242
  • Jentschke, S., Koelsch, S.S., Sallat, S., Friederici, A.D., Children with specific language impairment also show impairment of music-syntactic processing (2008) J. Cogn. Neurosci, 20, pp. 1940-1951
  • Koelsch, S., Kasper, E., Sammler, D., Schulze, K., Gunter, T., Friederici, A.D., Music, language and meaning: Brain signatures of semantic processing (2004) Nat. Neurosci, 7, pp. 302-307
  • Luck, G., Toiviainen, P., Erkkilä, J., Lartillot, O., Riikkilä, K., Mäkelä, A., Pyhäluoto, K., Värri, J., Modelling the relationships between emotional responses to, and musical content of, music therapy improvisations (2008) Psychol. Music, 36, pp. 25-45
  • Mesz, B., Trevisan, M.A., Sigman, M., The taste of music (2011) Perception, 40, pp. 209-219
  • Parise, C., Spence, C., Synaesthetic congruency modulates the temporal ventriloquism effect (2008) Neurosci. Lett, 442, pp. 257-261
  • Patel, A.D., Language, music, syntax and the brain (2003) Nat. Neurosci, 6, pp. 674-681
  • http://imslp.org/wiki; Plomp, R., Levelt, W.J.M., Tonal consonance and critical band-widths (1965) J. Acoust. Soc. Am, 38, pp. 548-560
  • Ramachandran, V.S., Hubbard, E.M., Hearing colors, tasting shapes (2003) Sci. Am, 288, pp. 52-59
  • Scherer, K.R., Vocal affect expression: A review and a model for future research (1986) Psychol. Bull, 99, pp. 143-165
  • Shukla, M., Nespor, M., Mehler, J., An interaction between prosody and statistics in the segmentation of fluent speech (2007) Cogn. Psychol, 54, pp. 1-32
  • Simner, J., Synaesthetic visuo-spatial forms: Viewing sequences in space (2009) Cortex, 45, pp. 1138-1147
  • Simner, J., Cuskley, C., Kirby, S., What sound does that taste? Cross-modal mappings across gustation and audition (2010) Perception, 39, pp. 553-569
  • Spence, C., Crossmodal correspondences: A tutorial review (2011) Atten. Percept. Psychophys, 73, pp. 971-995
  • Steiner, J.E., Human facial expressions in response to taste and smell stimulation (1979) Advances In Child Development and Behavior, 13, pp. 257-295. , eds H. W. Reese and L. P. Lipsitt (New York, NY: Academic Press
  • https://www.jyu.fi/hum/laitokset/musiikki/en/research/coe/materials/midi toolbox, Toolbox; Traunmüller, H., Eriksson, A., Acoustic effects of variation in vocal effort by men, women, and children (2010) J. Acoust. Soc. Am, 107, pp. 3438-3451
  • Walsh, V., A theory of magnitude: Common cortical metrics of time, space and quantity (2003) Tre Nd S Cogn. Sci, 7, pp. 483-488
  • Zatorre, R.J., Chen, J.L., Penhune, V.B., When the brain plays music: Auditory-motor interactions in music perception and production (2007) Nat. Rev. Neurosci, 8, pp. 547-558
  • Mesz, B., Sigman, M., Trevisan, M.A., A composition algorithm based on crossmodal taste-music correspondences (2012) Front. Hum. Neurosci, 6, p. 71. , doi: 10.3389/fnhum.2012.00071

Citas:

---------- APA ----------
Mesz, B., Sigman, M. & Trevisan, M.A. (2012) . A composition algorithm based on cross modal taste-music correspondences. Frontiers in Human Neuroscience(APRIL 2012).
Recuperado de https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_16625161_v_nAPRIL2012_p_Mesz [ ]
---------- CHICAGO ----------
Mesz, B., Sigman, M., Trevisan, M.A. "A composition algorithm based on cross modal taste-music correspondences" . Frontiers in Human Neuroscience, no. APRIL 2012 (2012).
Recuperado de https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_16625161_v_nAPRIL2012_p_Mesz [ ]
---------- MLA ----------
Mesz, B., Sigman, M., Trevisan, M.A. "A composition algorithm based on cross modal taste-music correspondences" . Frontiers in Human Neuroscience, no. APRIL 2012, 2012.
Recuperado de https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_16625161_v_nAPRIL2012_p_Mesz [ ]
---------- VANCOUVER ----------
Mesz, B., Sigman, M., Trevisan, M.A. A composition algorithm based on cross modal taste-music correspondences. Front. Human Neurosci. 2012(APRIL 2012).
Available from: https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_16625161_v_nAPRIL2012_p_Mesz [ ]