A New Validated Method for Improving the  Audiovisual Spatial Congruence in the Case of Stereoscopic-3D Video and Wave Field Synthesis

André, Cédric; Corteel, Etienne; Embrechts, Jean-Jacques; Verly, Jacques; Katz, Brian F.G.

doi:10.1109/IC3D.2013.6732081

Paper published in a book (Scientific congresses and symposiums)

A New Validated Method for Improving the Audiovisual Spatial Congruence in the Case of Stereoscopic-3D Video and Wave Field Synthesis

André, Cédric; Corteel, Etienne; Embrechts, Jean-Jacques et al.

2013 • In 3D Imaging (IC3D), 2013 International Conference on

Peer reviewed

Permalink
https://hdl.handle.net/2268/160841

DOI
10.1109/IC3D.2013.6732081

Files (2)Send to Details Statistics Bibliography Similar publications

Files

Full Text

postprint_submitted.pdf

Author postprint (1.73 MB)

Download

Annexes

CAndre_IC3D_slides.pdf

Publisher postprint (2.2 MB)

Slides de la présentation

Request a copy

© 2013 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

All documents in ORBi are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

Auditory-visual integration; stereoscopic video; Wave Field Synthesis; 3D cinema; three-dimensional television; auditory displays; audio-visual systems

Abstract :

[en] While 3D cinema is becoming increasingly established, little effort has focused on the general problem of producing a 3D sound scene spatially coherent with the visual content of a stereoscopic-3D (s-3D) movie. The perceptual relevance of such spatial audiovisual coherence is of significant interest. In this paper, we explain why the combination of accurate sound positioning and stereoscopic-3D images can lead to an incongruence between the sound and the image for multiple spectators. Then, we adapt to s-3D viewing a method originally proposed for 2D images in the literature to reduce this error. Finally, a subjective experiment is carried out to prove the efficiency of the method.

Disciplines :

Electrical & electronics engineering

Author, co-author :

André, Cédric ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Dép. d'électric., électron. et informat. (Inst.Montefiore)

Corteel, Etienne; sonic emotion labs

Embrechts, Jean-Jacques ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Techniques du son et de l'image

Verly, Jacques ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Exploitation des signaux et images

Katz, Brian F.G.; LIMSI-CNRS > Communication Homme-Machine > Groupe Audio & Acoustique

Language :

English

Title :

A New Validated Method for Improving the Audiovisual Spatial Congruence in the Case of Stereoscopic-3D Video and Wave Field Synthesis

Publication date :

December 2013

Event name :

International Conference on 3D Imaging (IC3D)

Event place :

Liège, Belgium

Event date :

du 3 au 5 décembre 2013

Audience :

International

Main work title :

3D Imaging (IC3D), 2013 International Conference on

Peer reviewed :

Peer reviewed

Additional URL :

http://dx.doi.org/10.1109/IC3D.2013.6732081

Available on ORBi :

since 09 January 2014

Statistics

Number of views

158 (3 by ULiège)

Number of downloads

314 (2 by ULiège)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

Bibliography

D. Alais and D. Burr. The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol., 14(3):257-262, February 2004
C. R. André, E. Corteel, J.-J. Embrechts, J. G. Verly, and B. F. G. Katz. Subjective evaluation of the audiovisual spatial congruence in the case of stereoscopic-3D video and Wave Field Synthesis. Int. J. Hum.-Comput. St., 72(1):23-32, January 2014
C. R. André, J.-J. Embrechts, and J. G. Verly. Adding 3D sound to 3D cinema: Identification and evaluation of different reproduction techniques. In Proc. 2nd Int. Conf. on Audio Language and Image Processing (ICALIP 2010), pages 130-137, 2010
C. R. André, M. Rébillat, J.-J. Embrechts, J. G. Verly, and B. F. G. Katz. Sound for 3D cinema and the sense of presence. In Proc. of the 18th Int. Conf. on Auditory Display (ICAD 2012), pages 14-21, Atlanta, GA, 2012
M. S. Banks, R. T. Held, and A. R. Girshick. Perception of 3-D layout in stereo displays. Inform. Display, 25(1):12-16, January 2009
M. L. Berenson, D. Levine, and T. C. Krehbiel. Basic Business Statistics. Prentice Hall, 12th edition, 2012
A. J. Berkhout, D. de Vries, and P. Vogel. Acoustic control by Wave Field Synthesis. J. Acoust. Soc. Am., 93(5):2764-2778, 1993
M. M. Boone. Multi-Actuator Panels (MAPs) as loudspeaker arrays for Wave Field Synthesis. J. Audio Eng. Soc., 52(7/8):712-723, 2004
E. Corteel. On the use of irregularly spaced loudspeaker arrays for Wave Field Synthesis, potential impact on spatial aliasing frequency. In Proc. 9th Int. Conf. on Digital Audio Effects (DAFx'06), Montréal, Canada, 2006
E. Corteel, L. Rohr, X. Falourd, K.-V. NGuyen, and H. Lissek. Practical 3-dimensional sound reproduction using Wave Field Synthesis, theory and perceptual validation. In Proc. of the 11th French Congr. of Acoustics and 2012 Annu. IOA Meeting, pages 895-900, Nantes, France, 2012
M. Courgeon. Multimodal affective and reactive characters. marc. limsi. fr, October 2013. (Last accessed: 2013/11/18)
M. Courgeon and C. Clavel. MARC: a framework that features emotion models for facial animation during human-computer interaction. J. Multimodal User Interfaces, pages 1-9, 2013
M. Courgeon, M. Rébillat, B. F. G. Katz, C. Clavel, and J.-C. Martin. Life-sized audiovisual spatial social scenes with multiple characters: MARC & SMART-I2. In Proc. of the 5emes Journées de l'AFRV, Orsay, France, December 2010
W. P. J. de Bruijn and M. M. Boone. Application of Wave Field Synthesis in life-size videoconferencing. In Audio Eng. Soc. Conv. 114, 2003
D. Doukhan, A. Rilliard, S. Rosset, M. Adda-Decker, and C. d'Alessandro. Prosodic analysis of a corpus of tales. In INTERSPEECH-2011, pages 3129-3132, 2011
Sonic Emotion. Sonic emotion absolute 3D sound. www. sonicemotion. com, October 2013. (Last accessed: 2013/11/18)
M. Evrard, C. R. André, J. G. Verly, J.-J. Embrechts, and B. F. G. Katz. Object-based sound re-mix for spatially coherent audio rendering of an existing stereoscopic-3D animation movie. In Audio Eng. Soc. Conv. 131, 2011
E. B. Goldstein. Spatial layout, orientation relative to the observer, and perceived projection in pictures viewed at an angle. J. Exp. Psychol. Human, 13(2):256-266, May 1987
E. B. Goldstein. Pictorial perception and art. In Blackwell Handbook of Sensation and Perception. Blackwell Publishing, 2005
C. V. Jackson. Visual factors in auditory localization. Q. J. Exp. Psychol., 5(2):52-65, 1953
J. Lewald, W. H. Ehrenstein, and R. Guski. Spatiotemporal constraints for auditory-visual integration. Behav. Brain Res., 121(1-2):69-79, June 2001
J. Lewald and R. Guski. Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. Cognitive Brain Res., 16(3):468-478, May 2003
C. Leys, C. Ley, O. Klein, P. Bernard, and L. Licata. Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median. J. Exp. Soc. Psychol., 49(4):764-766, July 2013
L. A. Marascuilo. Large-sample multiple comparisons. Psychol. Bull., 65(5):280-290, 1966
M. Rébillat, X. Boutillon, E. Corteel, and B. F. G. Katz. Audio, visual, and audio-visual egocentric distance perception by moving subjects in virtual environments. ACM Trans. Appl. Percept., 9(4):19:1-19:17, October 2012
M. Rébillat, E. Corteel, and B. F. G. Katz. SMART-I2: Spatial Multi-User Audio-Visual Real Time Interactive Interface. In Audio Eng. Soc. Conv. 125, 2008
M. Rébillat, B. F. G. Katz, and E. Corteel. SMARTI2: "Spatial multi-user audio-visual real-time interactive interface", A broadcast application context. In Proc. of the 3DTV Conf., Potsdam, Germany, 2009
D. A. Slutsky and G. H. Recanzone. Temporal and spatial dependency of the ventriloquism effect. Neuroreport, 12(1):7-10, January 2001
W. R. Thurlow and C. E. Jack. Certain determinants of the "ventriloquism effect". Percept. Motor Skill, 36:1171-1184, 1973
V. van Wassenhove, K. W. Grant, and D. Poeppel. Temporal window of integration in auditory-visual speech perception. Neuropsychologia, 45(3):598-607, January 2007
E. N. G. Verheijen. Sound reproduction by Wave Field Synthesis. PhD thesis, TU Delft, 1998
R. B. Welch. Meaning, attention, and the "unity assumption" in the intersensory bias of spatial and temporal perceptions. In Cognitive Contributions to the Perception of Spatial and Temporal Events, pages 371-387. Elsevier Science, 1999
A. J. Woods. Image distortions in stereoscopic video systems. In Proc. of SPIE 1915, pages 36-48, San Jose, CA, 1993
P. Zahorik, D. S. Brungart, and A. W. Bronkhorst. Auditory distance perception in humans: A summary of past and present research. Acta Acust. united with Acust., 91:409-420(12), May 2005.