Automated analysis of newborn cry: relationships between melodic shapes and native language

Automated acoustical analysis; Classification algorithms; Mother language; Newborn cry melody; Classification (of information); Decision trees; Fuzzy sets; Fuzzy systems; Acoustical analysis; Acoustical parameters; Classification algorithm; Language identification; Music and languages; Neuro fuzzy classifier; Automation

Abstract :

[en] Recent research studies have shown that since the last trimester of pregnancy human fetuses are able to listen to and possibly memorize auditory stimuli from the external world, both as music and language are concerned. In particular, they exhibit a specific sensitivity to prosodic features such as melody, intensity, and rhythm that are essential for an infant to learn and develop the native language. This paper presents first results concerning the automated mother language identification of a set of about 7500 cry units coming from French, Arabic and Italian mother-tongue healthy full term newborns. Acoustical parameters and 12 different melodic shapes are computed with the BioVoice software tool and their classification is performed with Random Forest and 4 neuro-fuzzy classifiers. Results show up to 95% differences among the three languages. © 2019 Elsevier Ltd

Disciplines :

Pediatrics

Author, co-author :

Manfredi, C.; Department of Information Engineering, Università degli Studi di Firenze, Firenze, Italy

VIELLEVOYE, Renaud ; Centre Hospitalier Universitaire de Liège - CHU > Département de Pédiatrie > Service néonatologie (CHR)

Orlandi, S.; Department of Information Engineering, Università degli Studi di Firenze, Firenze, Italy, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada

Torres-García, A.; Computer Science Department, Instituto Nacional de Astrofísica, Óptica y Electrónica (INAOE), Puebla, Mexico

Pieraccini, G.; Department of Information Engineering, Università degli Studi di Firenze, Firenze, Italy

Reyes-García, C. A.; Computer Science Department, Instituto Nacional de Astrofísica, Óptica y Electrónica (INAOE), Puebla, Mexico

Language :

English

Title :

Automated analysis of newborn cry: relationships between melodic shapes and native language

Publication date :

August 2019

Journal title :

Biomedical Signal Processing and Control

ISSN :

1746-8094

eISSN :

1746-8108

Publisher :

Elsevier Ltd

Volume :

Peer reviewed :

Peer Reviewed verified by ORBi

Available on ORBi :

since 03 August 2019

Statistics

Number of views

63 (2 by ULiège)

Number of downloads

3 (0 by ULiège)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

Bibliography

Kisilevsky, B.S., Hains, S.M., Brown, C.A., Lee, C.T., Cowperthwaite, B., Stutzman, S.S., Swansburg, M.L., Lee, K., Xie, X., Huang, H., Ye, H.H., Fetal sensitivity to properties of maternal speech and language. Infant Behav. Dev. 32 (2009), 59–71, 10.1016/j.infbeh.2008.10.002.
May, L., Byers-Heinlein, K., Gervain, J., Werker, J.F., Language and the newborn brain: does prenatal language experience shape the neonate neural response to speech?. Front. Psychol., 2, 2011, 222, 10.3389/fpsyg.2011.00222.
Marx, V., Nagy, E., Fetal behavioural responses to maternal voice and touch. PloS One, 10, 2015, e0129118, 10.1371/journal.pone.0129118.
Wermke, K., Mende, W., Manfredi, C., Bruscaglioni, P., Developmental aspects of infant's cry melody and formants. Med. Eng. Phys. 24 (2002), 501–514, 10.1016/S1350-4533(02)00061-9.
Mampe, B., Friederici, A.D., Christophe, A., Wermke, K., Newborns’ cry melody is shaped by their native language. Curr. Biol. 19 (2009), 1994–1997, 10.1016/j.cub.2009.09.064.
Wermke, K., Ruan, Y., Feng, Y., Dobnig, D., Stephan, S., Wermke, P., Ma, L., Chang, H., Liu, Y., Hesse, V., Shu, H., Fundamental frequency variation in crying of Mandarin and German neonates. J. Voice. 31 (2017), 255–e25, 10.1016/j.jvoice.2016.06.009.
Wermke, K., Robb, M.P., Fundamental frequency of neonatal crying: does body size matter?. J. Voice 24 (2010), 388–394, 10.1016/j.jvoice.2008.11.002.
Wermke, K., Leising, D., Stellzig‐Eisenhauer, A., Relation of melody complexity in infants’ cries to language outcome in the second year of life: a longitudinal study. Clin. Ling. Phon 21 (2007), 961–973, 10.1177/1029864909013002081.
Dobnig, D., Stephan, S., Wermke, P., Wermke, K., It all starts with music–musical intervals in neonatal crying. Speech Lang. Hear. 21 (2018), 77–80, 10.1080/2050571X.2017.1368973.
Prochnow, A., Erlandsson, S., Hesse, V., Wermke, K., Does a ‘musical'mother tongue influence cry melodies? A comparative study of Swedish and German newborns. Musicae Scientiae, 2017, 10.1177/1029864917733035.
Gustafson, G.E., Sanborn, S.M., Lin, H.C., Green, J.A., Newborns’ cries are unique to individuals (but not to language environment). Infancy 22 (2017), 736–747, 10.1111/infa.12192.
Shinya, Y., Kawai, M., Niwa, F., Imafuku, M., Myowa, M., Fundamental frequency variation of neonatal spontaneous crying predicts language acquisition in preterm and term infants. Front. Psychol., 8, 2017, 2195, 10.3389/fpsyg.2017.02195.
Reyes-Galaviz, O.F., Tirado, E.A., Reyes-Garcia, C.A., Classification of infant crying to identify pathologies in recently born babies with ANFIS. International Conference on Computers for Handicapped Persons, 2004, 408–415, 10.1007/978-3-540-27817-7_60.
Wermke, K., Birr, M., Voelter, C., Shehata, W.D., Jurkutat, A., Wermke, P., Stellzig, A.E., Cry melody in 2-month-old infants with and without clefts. Cleft Palate-Craniofacial J. 48 (2011), 321–330, 10.1597/09-055.
Várallyay, G. Jr, The melody of crying. Int. J. Pediatr. Otorhinolaryngol. 71 (2007), 1699–1708, 10.1016/j.ijporl.2007.07.005.
Wermke, K., Mende, W., Musical elements in human infants’ cries: in the beginning is the melody. Musicae Scientiae 13 (2009), 151–175, 10.1177/1029864909013002081.
Várallyay, G. Jr., Infant cry analyzer system for hearing disorder detection. Periodica politechnica, TU timişoara. Trans. Autom. Control Comput. Sci. 49:63 (2004), 57–60.
Varallyay, G.J., Benyó, Z., Illényi, A., Farkas, Z., Kovács, L., Acoustic analysis of the infant cry: classical and new methods. Engineering in Medicine and Biology Society, 2004. IEMBS'04. 26th Annual International Conference of the IEEE 2004 Sep 1 vol. 1 (2004), 313–316, 10.1109/IEMBS.2004.1403155.
Wermke, K., Teiser, J., Yovsi, E., Kohlenberg, P.J., Wermke, P., Robb, M., Keller, H., Lamm, B., Fundamental frequency variation within neonatal crying: does ambient language matter? Speech. Lang. Hear. 19 (2016), 211–217, 10.1080/2050571X.2016.1187903.
Levitt, A.G., Wang, Q., Evidence for language-specific rhythmic influences in the reduplicative babbling of French-and English-learning infants. Lang. Speech 34 (1991), 235–249, 10.1177/002383099103400302.
Hallé, P.A., De Boysson-Bardies, B., Vihman, M.M., Beginnings of prosodic organization: intonation and duration patterns of disyllables produced by Japanese and French infants. Lang. Speech. 34 (1991), 299–318, 10.1177/002383099103400401.
Oren, A., Matzliach, A., Cohen, R., Friedman, H., Cry-based detection of developmental disorders in infants. InScience of Electrical Engineering (ICSEE), IEEE International Conference on the 2016 Nov 16, 2016, 1–5, 10.1109/ICSEE.2016.7806073.
Díaz, M.A., García, C.A., Robles, L.C., Altamirano, J.E., Mendoza, A.V., Automatic infant cry analysis for the identification of qualitative features to help opportune diagnosis. Biomed. Signal Process. Control. 7 (2012), 43–49, 10.1016/j.bspc.2011.06.011.
Várallyay, G., Illényi, A., Benyó, Z., Melody analysis of the newborn infant cries, MAVEBA, Models and Analysis of Vocal Emissions for Biomedical Applications - 6th International Workshop. 2009, Firenze University Press, 7–10.
Orlandi, S., Bandini, A., Fiaschi, F.F., Manfredi, C., Testing software tools for newborn cry analysis using synthetic signals. Biomed. Signal Process. Control. 37 (2017), 16–22, 10.1016/j.bspc.2016.12.012.
Manfredi, C., Bandini, A., Melino, D., Viellevoye, R., Kalenga, M., Orlandi, S., Automated detection and classification of basic shapes of newborn cry melody. Biomed. Signal Process. Control 45 (2018), 174–181, 10.1016/j.bspc.2018.05.033.
Manfredi, C., Bocchi, L., Orlandi, S., Spaccaterra, L., Donzelli, G.P., High-resolution cry analysis in preterm newborn infants. Med. Eng. Phys. 31 (2009), 528–532, 10.1016/j.medengphy.2008.10.003.
Manfredi, C., Tocchioni, V., Bocchi, L., A robust tool for newborn infant cry analysis. In engineering in medicine and biology society. EMBS'06. 28th Annual International Conference of the IEEE, 2006, 509–512, 10.1109/IEMBS.2006.4397448 2006 Aug 30.
Orlandi, S., Manfredi, C., Bocchi, L., Scattoni, M.L., Automatic newborn cry analysis: a non-invasive tool to help autism early diagnosis. 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society 2012 Aug 28, 2012, 2953–2956, 10.1109/ EMBC.2012.6346583.
Orlandi, S., Dejonckere, P.H., Schoentgen, J., Lebacq, J., Rruqja, N., Manfredi, C., Effective pre-processing of long term noisy audio recordings: an aid to clinical monitoring. Biomed. Signal Process. Control. 8 (2013), 799–810, 10.1016/j.bspc.2013.07.009.
Manfredi, C., Pieraccini, G., Viellevoye, R., Reyes-García, C.A., Relationships between newborn's cry melody shapes and native language. Models and Analysis of Vocal Emissions for Biomedical Applications: 10th International Workshop, December 13-15, 2017 2017 Nov 30, vol. 117, 2017, 47 ISBN 978-88-6453-607-1.
Orlandi, S., Garcia, C.A., Bandini, A., Donzelli, G., Manfredi, C., Application of pattern recognition techniques to the classification of full-term and preterm infant cry. J. Voice 30 (2016), 656–663, 10.1016/j.jvoice.2015.08.007.
Sun, C.T., Jang, J.S., A neuro-fuzzy classifier and its applications. In Fuzzy systems. Second IEEE International Conference on 1993, 1993, 94–98, 10.1109/FUZZY.1993.327457.
Cetişli, B., Barkana, A., Speeding up the scaled conjugate gradient algorithm and its application in neuro-fuzzy classifier training. Soft Comput. 14:4 (2010), 365–378.
Cetisli, B., Development of an adaptive neuro-fuzzy classifier using linguistic hedges: Part 1. Expert Syst. Appl. 37 (2010), 6093–6101, 10.1016/j.eswa.2010.02.108.
Cetisli, B., The effect of linguistic hedges on feature selection: Part 2. Expert Syst. Appl. 37 (2010), 6102–6108, 10.1016/j.eswa.2010.02.115.
Schönweiler, R., Kaese, S., Möller, S., Rinscheid, A., Ptok, M., Neuronal networks and self-organizing maps: new computer techniques in the acoustic evaluation of the infant cry. Int. J. Pediatr. Otorhinolaryngol., 38, 1996, 10.1016/S0165-5876(96)01389-4 1-1.
Sharma, P., Kaur, M., Classification in pattern recognition: a review. Int. J. Adv. Res. Comput. Sci. Software Eng., 3, 2013.
Rokach, L., A survey of clustering algorithms. Data Mining and Knowledge Discovery Handbook, 2009, Springer, Boston, MA, 269–298, 10.1109/TNN.2005.845141.
Torres-García, A.A., Reyes-García, C.A., Villaseñor-Pineda, L., García-Aguilar, G., Implementing a fuzzy inference system in a multibjective EEG channel selection model for imagined speech classification. Expert Syst. Appl. 59 (2016), 1–12, 10.1016/j.eswa.2016.04.011.
González-Castañeda, E.F., Torres-García, A.A., Reyes-García, C.A., Villaseñor-Pineda, L., Sonification and textification: emerging methods for classifying unspoken words from EEG signals. Biomed. Signal Process. Control 37 (2017), 82–89, 10.1016/j.bspc.2016.10.012.
Corwin, M.J., Lester, B.M., Golub, H.L., The infant cry: what can it tell us?. Curr. Probl. Pediatr. 26 (1996), 313–334, 10.1016/S0045-9380(96)80012-0.
Mende, W., Wermke, K., Schindler, S., Wilzopolski, K., Hock, S., Variability of the cry melody and the melody spectrum as indicators for certain CNS disorders. Early Child Dev. Care 65 (1990), 95–107, 10.1080/0300443900650112.
Munck, P., Maunu, J., Kirjavainen, J., Lapinleimu, H., Haataja, L., Lehtonen, L., PIPARI study group. Crying behaviour in early infancy is associated with developmental outcome at two years of age in very low birth weight infants. Acta Paediatrica 97 (2008), 332–336, 10.1111/j.1651-2227.2008.00673.x.
Als, H., McAnulty, G.B., The newborn individualized developmental care and assessment program (NIDCAP)with kangaroo mother care (KMC): comprehensive care for preterm infants. Current Women's Health Rev. 7 (2011), 288–301, 10.2174/157340411796355216.
Amato, F., Cannataro, M., Cosentino, C., Garozzo, A., Lombardo, N., Manfredi, C., Montefusco, F., Tradigo, G., Veltri, P., Early detection of voice diseases via a web-based system. Biomed. Signal Process. Control. 4 (2009), 206–211, 10.1016/j.bspc.2009.01.005.