I-see-3D! An Interactive and Immersive System that dynamically adapts 2D projections to the location of a user’s eyes

Pierard, Sébastien; Pierlot, Vincent; Lejeune, Antoine; Van Droogenbroeck, Marc

doi:10.1109/IC3D.2012.6615140

Download

Paper published in a book (Scientific congresses and symposiums)

I-see-3D! An Interactive and Immersive System that dynamically adapts 2D projections to the location of a user’s eyes

Pierard, Sébastien; Pierlot, Vincent; Lejeune, Antoine et al.

2012 • In International Conference on 3D Imaging (IC3D)

Peer reviewed

Permalink
https://hdl.handle.net/2268/134431

DOI
10.1109/IC3D.2012.6615140

Files (2)Send to Details Statistics Bibliography Similar publications

Files

Full Text

Pierard2012ISee3D.pdf

Author postprint (1.95 MB)

I-see-3D! An Interactive and Immersive System that dynamically adapts 2D projections to the location of a user's eyes

Download

Annexes

Pierard2012ISee3D-presentation.pdf

Publisher postprint (14.18 MB)

Presentation

Download

All documents in ORBi are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

3D; Projection; Immersion; Calibration; Pinhole; Head coupled perspective; Tracking; Kalman filtering; OpenGL; Laser; Kinect

Abstract :

[en] This paper presents a system that gives the illusion of a 3D immersive and interactive environment with 2D projectors. The user does not need to wear glasses, nor to watch a (limited) screen. The virtual world is all around him, drawn on the floor. As the user is himself immersed in the virtual world, there is no need for a proxy like an avatar; he can move inside the virtual environment freely. Moreover, the Isee-3D system allows a user to manipulate virtual objects with his own body, making interactions with the virtual world very intuitive. Giving the illusion of 3D requires to render images insuch a way that the deformation of the image projected on thefloor is taken into account, as well as the position of the user’s “eye” in its virtual world. The resulting projection is neither perspective nor orthographic. Nevertheless, we describe how thiscan be implemented with the standard OpenGL pipeline, without any shader. Our experiments demonstrate that our system is effective in giving the illusion of 3D. Videos showing the results obtained with our I-see-3D system are available on our website http://www.ulg.ac.be/telecom/projector

Research center :

Intelsig
Telim

Disciplines :

Computer science

Author, co-author :

Pierard, Sébastien ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Télécommunications

Pierlot, Vincent ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Dép. d'électric., électron. et informat. (Inst.Montefiore)

Lejeune, Antoine ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Exploitation des signaux et images

Van Droogenbroeck, Marc ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Télécommunications

Language :

English

Title :

I-see-3D! An Interactive and Immersive System that dynamically adapts 2D projections to the location of a user’s eyes

Publication date :

December 2012

Event name :

International Conference on 3D Imaging (IC3D)

Event place :

Liège, Belgium

Event date :

from 3-12-2012 to 6-12-2012

Audience :

International

Main work title :

International Conference on 3D Imaging (IC3D)

Pages :

Peer reviewed :

Peer reviewed

Available on ORBi :

since 19 November 2012

Statistics

Number of views

545 (52 by ULiège)

Number of downloads

775 (23 by ULiège)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

Bibliography

A. Lejeune, S. Piérard, M. Van Droogenbroeck, and J. Verly, "Utilisation de la Kinect", Linux Magazine France, vol. 151, pp. 16-29, Juillet-Août 2012.
S. Piérard, D. Leroy, J.-F. Hansen, and M. Van Droogenbroeck, "Estimation of human orientation in images captured with a range camera", in Advances Concepts for Intelligent Vision Systems (ACIVS), ser. Lecture Notes in Computer Science, vol. 6915. Springer, 2011, pp. 519-530.
J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake, "Real-time human pose recognition in parts from single depth images", in IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, June 2011.
J. Francone and L. Nigay, "Using the user's point of view for interaction on mobile devices", in French Speaking Conference on Human-Computer Interaction (IHM). Sophia Antipolis, France: ACM, October 2011, p. 8 pages.
C. Cruz-Neira, D. Sandin, T. De Fanti, R. Kenyon, and J. Hart, "The CAVE: audio visual experience automatic virtual environment", Communications of the ACM, vol. 35, no. 6, pp. 64-72, June 1992.
C. Cruz-Neira, D. Sandin, and T. De Fanti, "Surround-screen projectionbased virtual reality: the design and implementation of the CAVE", in Proceedings of the 20th SIGGRAPH conference, Anaheim, USA, August 1993, pp. 135-142.
J. Lee, "Hacking the nintendo wii remote", IEEE Pervasive Computing, vol. 7, no. 3, pp. 39-45, July-September 2008.
K. Leo and B. Tan, "User-tracking mobile floor projection virtual reality game system for paediatric gait & dynamic balance training", in Proceedings of the 4th International Convention on Rehabilitation Engineering & Assistive Technology (iCREATe), Singapore, July 2010, pp. 25:1-25:4.
H. Regenbrecht, S. Hoermann, G. McGregor, B. Dixon, E. Franz, C. Ott, L. Hale, T. Schubert, and J. Hoermann, "Visual manipulations for motor rehabilitation", Computers & Graphics, vol. 36, no. 7, pp. 819-834, 2012.
Y. Gu, A. Lo, and I. Niemegeers, "A survey of indoor positioning systems for wireless personal networks", IEEE Communications Surveys & Tutorials, vol. 11, no. 1, pp. 13-32, First Quarter 2009.
N. Priyantha, A. Chakraborty, and H. Balakrishnan, "The cricket location-support system", in International conference on Mobile computing and networking. Boston, MA, United States: ACM, 2000, pp. 32-43.
P. Bahl and V. Padmanabhan, "RADAR: an in-building RF-based user location and tracking system", in Joint Conference of the IEEE Computer and Communications Societies, vol. 2, Tel Aviv, Israel, March 2000, pp. 775-784.
H. Rimminen, J. Lindström, and R. Sepponen, "Positioning accuracy and multi-target separation with a human tracking system using near field imaging", International Journal on Smart Sensing and Intelligent Systems, vol. 2, no. 1, pp. 156-175, March 2009.
P. Viola and M. Jones, "Robust real-time face detection", International Journal of Computer Vision, vol. 57, no. 2, pp. 137-154, 2004.
B. Chakraborty, O. Rudovic, and J. Gonzàlez, "View-invariant humanbody detection with extension to human action recognition using component-wise HMM of body parts", in IEEE International Conference on Automatic Face and Gesture Recognition (FGR), Amsterdam, The Netherlands, September 2008.
M. Lee and R. Nevatia, "Body part detection for human pose estimation and tracking", in IEEE Workshop on Motion and Video Computing (WMVC), Austin, USA, February 2007.
G. Mori and J. Malik, "Estimating human body configurations using shape context matching", in European Conference on Computer Vision (ECCV), ser. Lecture Notes in Computer Science, vol. 2352. Springer, 2002, pp. 150-180.
I. Haritaoglu, D. Harwood, and L. Davis, "Ghost: a human body part labeling system using silhouettes", in IEEE International Conference on Pattern Recognition (ICPR), Brisbane, Australia, August 1998.
O. Barnich and M. Van Droogenbroeck, "ViBe: A universal background subtraction algorithm for video sequences", IEEE Transactions on Image Processing, vol. 20, no. 6, pp. 1709-1724, June 2011.
R. Girshick, J. Shotton, P. Kohli, A. Criminisi, and A. Fitzgibbon, "Efficient regression of general-activity human poses from depth images", in International Conference on Computer Vision (ICCV), Barcelona, Spain, November 2011.
Y. Zhu, B. Dariush, and K. Fujimura, "Controlled human pose estimation from depth image streams", in IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Anchorage, AK, USA, June 2008, pp. 1-8.
C. Plagemann, V. Ganapathi, D. Koller, and S. Thrun, "Real-time identification and localization of body parts from depth images", in IEEE International Conference on Robotics and Automation (ICRA), May 2010, pp. 3108-3113.
Z. Li and D. Kulić, "Local shape context based real-time endpoint body part detection and identification from depth images", in Canadian conference on computer and robot vision (CRV), St. John's, Canada, May 2011, pp. 219-226.
S. Piérard, V. Pierlot, O. Barnich, M. Van Droogenbroeck, and J. Verly, "A platform for the fast interpretation of movements and localization of users in 3D applications driven by a range camera", in 3DTV Conference, Tampere, Finland, June 2010.
S. Piérard, M. Van Droogenbroeck, R. Phan-Ba, and S. Belachew, "A new low-cost and non-intrusive feet tracker", in Workshop on Circuits, Systems and Signal Processing (ProRISC), Veldhoven, The Netherlands, November 2011, pp. 382-387. [Online]. Available: http://hdl.handle.net/2268/ 101296
R. Kalman, "A new approach to linear filtering and prediction problems", Journal of Basic Engineering, vol. 82, no. D, pp. 35-45, 1960.
Y. Bar-Shalom, X.-R. Li, and T. Kirubarajan, Estimation with Applications to Tracking and Navigation: Theory Algorithms and Software. New York, NY, USA: John Wiley & Sons, Inc., 2001.
M. Deza and E. Deza, Encyclopedia of Distances. Springer, 2009.
J. Lee, P. Dietz, D. Maynes-Aminzade, R. Raskar, and S. Hudson, "Automatic projector calibration with embedded light sensors", in Proceedings of the 17th annual ACM symposium on User interface software and technology (UIST). Santa Fe, USA: ACM, October 2004, pp. 123-126.
J. Lee, "Projector-based location discovery and tracking", Ph. D. dissertation, Carnegie Mellon University, May 2008.