[en] The increasing number of casting shows and talent contests in the media over the past years suggests a public interest in rating the quality of vocal performances. In many of these formats, laymen alongside music experts act as judges. Whereas experts' judgments are considered objective and reliable when it comes to evaluating singing voice, little is known about laymen’s ability to evaluate peers. On the one hand, layman listeners–who by definition did not have any formal training or regular musical practice–are known to have internalized the musical rules on which singing accuracy is based. On the other hand, lay- man listeners’ judgment of their own vocal skills is highly inaccurate. Also, when compared with that of music experts, their level of competence in pitch perception has proven limited. The present study investigates laypersons' ability to objectively evaluate melodies per- formed by untrained singers. For this purpose, laymen listeners were asked to judge sung melodies. The results were compared with those of music experts who had performed the same task in a previous study. Interestingly, the findings show a high objectivity and reliabil- ity in layman listeners. Whereas both the laymen's and experts' definition of pitch accuracy overlap, differences regarding the musical criteria employed in the rating task were evident. The findings suggest that the effect of expertise is circumscribed and limited and supports the view that laypersons make trustworthy judges when evaluating the pitch accuracy of untrained singers.
Disciplines :
Neurosciences & behavior
Author, co-author :
Larrouy-Maestri, Pauline ; Université de Liège > Département de Psychologie : cognition et comportement > Max Planck Institute for Empirical Asthetics, Frankfurt, Germany
Magis, David ; Université de Liège > Département Education et formation > Psychométrie et édumétrie
Grabenhorst, Matthias
Morsomme, Dominique ; Université de Liège > Département de Psychologie : cognition et comportement > Logopédie des troubles de la voix
Language :
English
Title :
Layman versus Professional Musician: Who Makes the Better Judge?
Publication date :
2015
Journal title :
PLoS ONE
eISSN :
1932-6203
Publisher :
Public Library of Science, San Franscisco, United States - California
Watts C, Barnes-Burroughs K, Andrianopoulos M, Carr M. Potential factors related to untrained singing talent: A survey of singing pedagogues. J Voice. 2003; 17(3): 298-307. PMID: 14513953
Cross I. Music, Cognition, Culture, and Evolution. Ann N Y Acad Sci. 2001; 930: 28-42. PMID: 11458835
Lerdahl F, Jackendoff R. A generative theory of tonal music. Cambridge, MA: MIT Press; 1983.
Larrouy-Maestri P, Morsomme D. Criteria and tools for objectively analysing the vocal accuracy of a popular song. Logoped Phoniatr Vocol. 2014; 39(1): 11-18. doi: 10.3109/14015439.2012.696139 PMID: 22721558
Larrouy-Maestri P, Lévêque Y, Schön D, Giovanni A, Morsomme D. The evaluation of singing voice accuracy: A comparison between subjective and objective methods. J Voice. 2013; 27(2): 259.e1-259. e5.
Wise KJ, Sloboda JA. Establishing an empirical profile of self-defined "tone deafness": Perception, singing performance and self-assessment. Music Sci. 2008; 12(1): 3-26.
Racette A, Bard C, Peretz I. Making non-fluent aphasics speak: Sing along! Brain. 2006; 129(10): 2571-2584.
Pfordresher PQ, Brown S. Poor-Pitch Singing in the Absence of "Tone Deafness". Music Percept. 2007; 25(2): 95-115.
Cuddy LL, Balkwill LL, Peretz I, Holden RR. Musical difficulties are rare: A study of "tone deafness" among university students. Ann N Y Acad Sci. 2005; 1060: 311-324. PMID: 16597781
Sloboda JA, Wise KJ, Peretz I. Quantifying tone deafness in the general population. Ann N Y Acad Sci. 2005; 1060: 255-261. PMID: 16597772
Wise KJ, Sloboda JA, Peretz I. Progress in Understanding "Tone Deafness". Brit Acad Rev. 2007 (10): 52-54.
Burson KA, Larrick RP, Klayman J. Skilled or unskilled, but still unaware of it: How perceptions of difficulty drive miscalibration in relative comparisons. J Pers Soc Psychol. 2006; 90(1): 60-77. PMID: 16448310
Parker ZJ, Waller G. Factors related to psychotherapists' self-assessment when treating anxiety and other disorders. Behav Res Ther. 2015; 66: 1-7. doi: 10.1016/j.brat.2014.12.010 PMID: 25614972
Ackerman PL. Nonsense, common sense, and science of expert performance: Talent and individual differences. Intelligence. 2014; 45: 6-17.
Ericsson KE, Krampe RT, Tesch-Römer C. The role of deliberate practice in the acquisition of expert performance. APA. 1993; 100: 363-406.
Lehmann AC, Ericsson KA. Research on experts performance and deliberate practice: Implications for the education of amateur musicians and music students. Psychomusicology. 1997; 16: 40-58.
Lehmann AC, Gruber H. Music. In: Ericsson K.A C N, Feltovich P.J., Hoffman R.R., editor. The Cambridge Handbook of Expertise and Expert Performances. 2006. p. 457-470.
Platz F, Kopiez R, Lehmann AC, Wolf A. The influence of deliberate practice on musical achievement: A meta-analysis. Front Psychol. 2014; 5: 646. doi: 10.3389/fpsyg.2014.00646 PMID: 25018742
Davidson JW, Howe MJA, Moore DG, Sloboda JA. The role of parental influences in the development of musical performance. Br J Dev Psychol. 1996; 14: 399-412.
McPherson GE, Zimmermann BJ. Self-regulation of musical learning: A social cognitive perspective. In: Colwell R, Richardson C, editors. The new Handbook of Research on Music Teaching and Learning. New York: Oxford University Press; 2002. p. 327-347.
Butkovic A, Ullén F, Mosing MA. Personality related traits as predictors of music practice: Underlying environmental and genetic influences. Pers Individ Dif. 2015; 74: 133-138.
Mosing MA, Madison G, Pedersen NL, Kuja-Halkola R, Ullén F. Practice does not make perfect: No causal effect of music practice on music ability. Psychol Sci. 2014; 25(9): 1795-1803. doi: 10.1177/0956797614541990 PMID: 25079217
Hambrick DZ, Oswald FL, Altmann EM, Meinz EJ, Gobet F, Campitelli G. Deliberate practice: Is that all it takes to become an expert? Intelligence. 2014; 45: 34-45.
Hambrick DZ, Altmann EM, Oswald FL, Meinz EJ, Gobet F. Facing facts about deliberate practice. Front Psychol. 2014; 5.
Plomin R, Shakeshaft NG, McMillan A, Trzaskowski M. Nature, Nurture, and Expertise. Intelligence. 2014; 45: 46-59. PMID: 24948844
Simonton DK. Exceptional talent and genius. In: Chamorro-Tremuzic T, von Stumm S, Furnham A, editors. The Wiley-Blackwell Handbook of Individual Differences. 1st ed. Chichester, United Kingdom: Blackwell Publishing Ltd.; 2011. p. 635.
Bunch M, Chapman J. Taxonomy of singers used as subjects in scientific research. J Voice. 2000; 14 (3): 363-369. PMID: 11021503
Moore BC. Frequency difference limens for short-duration tones. J Acoust Soc Am. 1973; 54(3): 610-619. PMID: 4754385
Micheyl C, Delhommeau K, Perrot X, Oxenham AJ. Influence of musical and psychoacoustical training on pitch discrimination. Hear Res. 2006; 219(1-2): 36-47. PMID: 16839723
Tervaniemi M, Just V, Koelsch S, Widmann A, Schroger E. Pitch discrimination accuracy in musicians vs nonmusicians: An event-related potential and behavioral study. Exp Brain Res. 2005; 161(1): 1-10. PMID: 15551089
Schellenberg EG, W. Weiss M. Music and Cognitive Abilities. In: Deutsch D, editor. The Psychology of Music. 3rd ed: Elsevier; 2013. p. 499-550.
Hutchins SM, Peretz I. A frog in your throat or in your ear? Searching for the causes of poor singing. J Exp Psychol Gen. 2012; 141(1): 76-97. doi: 10.1037/a0025064 PMID: 21875245
Russo FA, Thompson WF. An interval size illusion: The influence of timbre on the perceived size of melodic intervals. Percept Psychophys. 2005; 67(4): 559-568. PMID: 16134451
Hutchins S, Roquet C, Peretz I. The vocal generosity effect: How bad can your singing be? Music Percept. 2012; 30(2): 147-159.
Vurma A, Raju M, Kuuda A. Does timbre affect pitch?: Estimations by musicians and non-musicians. Psychol Music. 2010; 39(3): 291-306.
Zarate JM, Ritson CR, Poeppel D. The effect of instrumental timbre on interval discrimination. PLoS One. 2013; 8(9): 1-9.
Warrier CM, Zatorre RJ. Influence of tonal context and timbral variation on perception of pitch. Percept Psychophys. 2002; 64(2): 198-207. PMID: 12013375
Fujioka T, Trainor LJ, Ross B, Kakigi R, Pantev C. Musical training enhances automatic encoding of melodic contour and interval structure. J Cogn Neurosci. 2004; 16(6): 1010-1021. PMID: 15298788
Schön D, Magne C, Besson M. The music of speech: Music training facilitates pitch processing in both music and language. Psychophysiology. 2004; 41(3): 341-349. PMID: 15102118
Koelsch S, Jentschke S, Sammler D, Mietchen D. Untangling syntactic and sensory processing: An ERP study of music perception. Psychophysiology. 2007; 44(3): 476-490. PMID: 17433099
Schellenberg EG, Moreno S. Music lessons, pitch processing, and g. Psychol Music. 2010: 209-221.
Strait DL, Kraus N, Parbery-Clark A, Ashley R. Musical experience shapes top-down auditory mechanisms: Evidence from masking and auditory attention performance. Hear Res. 2010; 261(1-2): 22-29. doi: 10.1016/j.heares.2009.12.021 PMID: 20018234
Lee H, Noppeney U. Music expertise shapes audiovisual temporal integration windows for speech, sinewave speech, and music. Front Psychol. 2014; 5: 868. doi: 10.3389/fpsyg.2014.00868 PMID: 25147539
Kinney DW. Internal consistency of performance evaluations as a function of music expertise and excerpt familiarity. J Res Music Edu. 2009; 56(4): 322-337.
Morrison SJ, Montemayer M, Wiltshire ES. The effect of a recorded model on band students' performance self-evaluations, achievement and attitude. J Res Music Edu. 2004; 52: 116-129.
Fiske HE. Judge-group differences in the rating of secondary school trumpet performances. J Res Music Edu. 1975; 23: 186-196.
Fiske HE. Relationship of selected factors in trumpet performance adjudication. J Res Music Edu. 1977; 25: 256-263.
Fiske HE. The effect of a training procedure in musical performance evaluation on judge reliability. Canada, Toronto: Ontario Educational Research Council Report. 1978.
Wapnick J, Flowers PJ, Alegant M, Jasinskas L. Consistency in piano performance evaluation. J Res Music Edu. 1993(41): 282-292.
Besson M, Faïta F. An Event-Related Potential (ERP) study of musical expectancy: Comparison of musicians with nonmusicians. J Exp Psychol Hum Percept Perform. 1995; 21(6): 1278-1296.
Jonaitis EMM, SJ R. Learning harmony: The role of serial statistics. Cogn Sci. 2009; 33: 951-968. doi: 10.1111/j.1551-6709.2009.01036.x PMID: 21585492
Loui P, Wessel DL, Kam CLH. Humans rapidly learn grammatical structure in a new musical scale. Music Percept. 2010; 27(5): 377-388. PMID: 20740059
Bigand E, Delbé C. L'apprentissage implicite de la musique occidentale. In: Kolinsky R, Morais J, Peretz I, editors. Musique, Langage, Emotion: Approche neuro-cognitive Rennes, France: Presses Universitaires de Rennes; 2010. p. 35-47.
Hannon E, Trainor L. Music acquisition: Effects of enculturation and formal training on development. Trends Cogn Sci. 2007.
Müllensiefen D, Gingras B, Musil J, Stewart L. The musicality of non-musicians: An index for assessing musical sophistication in the general population. PLoS One. 2014; 9(2): E89642. doi: 10.1371/journal. pone.0089642 PMID: 24586929
Stalinski SM, Schellenberg EG. Music cognition: A developmental perspective. Top Cogn Sci. 2012; 4 (4): 485-497. doi: 10.1111/j.1756-8765.2012.01217.x PMID: 22811391
Trainor LJ. Are there critical periods for musical development? Dev Psychobiol. 2005; 46(3): 262-278. PMID: 15772967
Trainor LJ, Marie C, Gerry D, Whiskin E, Unrau A. Becoming musically enculturated: Effects of music classes for infants on brain and behavior. Ann N Y Acad Sci. 2012; 1252: 129-138. doi: 10.1111/j.1749-6632.2012.06462.x PMID: 22524350
Dowling WJ, Fujitani DS. Contour, interval, and pitch recognition in memory for melodies. J Acoust Soc Am. 1971; 49(2): 524-531. PMID: 5541747
Edworthy J. Interval and contour in melody processing. Music Percept. 1985; 2: 375-388.
Stalinski SM, Schellenberg EG, Trehub SE. Developmental changes in the perception of pitch contour: Distinguishing up from down. J Acoust Soc Am. 2008; 124(3): 1759. doi: 10.1121/1.2956470 PMID: 19045665
Trainor LJ, Trehub SE. A comparison of infants' and adults' sensitivity to western musical structure. J Exp Psychol Hum Percept Perform. 1992; 18(2): 394-402. PMID: 1593226
Bigand E, Poulincharronnat B. Are we "experienced listeners"? A review of the musical capacities that do not depend on formal musical training. Cognition. 2006; 100(1): 100-130. PMID: 16412412
Peretz I, Champod AS, Hyde K. Varieties of Musical Disorders: The Montreal Battery of Evaluation of Amusia. Ann N Y Acad Sci. 2003; 999: 58-75. PMID: 14681118
Novembre G, Keller PE. A conceptual review on action-perception coupling in the musicians' brain: What is it good for? Front Hum Neurosci. 2014; 8: 603. doi: 10.3389/fnhum.2014.00603 PMID: 25191246
Kajihara T, Verdonschot RG, Sparks J, Stewart L. Action-perception coupling in violinists. Front Hum Neurosci. 2013; 7: 349. doi: 10.3389/fnhum.2013.00349 PMID: 23908612
Haueisen J, Knosche TR. Involuntary motor activity in pianists evoked by music perception. J Cogn Neurosci. 2001; 13(6): 786-792. PMID: 11564322
Gebel B, Braun C, Kaza E, Altenmüller E, Lotze M. Instrument specific brain activation in sensorimotor and auditory representation in musicians. Neuroimage. 2013; 74: 37-44. doi: 10.1016/j.neuroimage. 2013.02.021 PMID: 23454048
Lahav A, Saltzman E, Schlaug G. Action representation of sound: Audiomotor recognition network while listening to newly acquired actions. J Neurosci. 2007; 27(2): 308-314. PMID: 17215391
Walfish S, McAlister B, O'Donnell P, Lambert MJ. An investigation of self-assessment bias in mental health providers. Psychol Rep. 2012; 110(2): 639-644. PMID: 22662416
Stalinski SM, Schellenberg EG, Trehub SE. Developmental changes in the perception of pitch contour: Distinguishing up from down. J Acoust Soc Am. 2008; 124(3): 1759-1763. doi: 10.1121/1.2956470 PMID: 19045665
Pfordresher PQ, Larrouy-Maestri P. On drawing a line through the spectrogram: How do we understand deficits of vocal pitch imitation? Front Hum Neurosci. 2015; 9: 271. doi: 10.3389/fnhum.2015.00271 PMID: 26029088
Larrouy-Maestri P, Magis D, Morsomme D. Effects of melody and technique on acoustical and musical features of western operatic singing voices. J Voice. 2014; 28(3): 332-340. doi: 10.1016/j.jvoice.2013. 10.019 PMID: 24495421
Larrouy-Maestri P, Gosselin L, Blanckaert E, Morsomme D. Listeners' tolerance when listening to melodic performances. Ninth Triennial of the European Society for the Cognitive Sciences of Music 17-22 August; Manchester, UK2015.
Tsay CJ. Sight over sound in the judgment of music performance. Proc Natl Acad Sci U S A. 2013; 110 (36): 14580-14585. doi: 10.1073/pnas.1221454110 PMID: 23959902