Immersive Communication | Nokia Research Center

The team studies the essential elements and experiences of human communication. It develops technologies for achieving new levels of quality and closeness in telecommunication and enabling new forms of co-presence and collaboration.

3D audio-visual technologies, multi-modal interaction methods and advanced computer vision solutions are used to develop personal high immersion interfaces to mixed-reality environments and real-time multi-user communication systems.

Psychological and perceptional aspects of communication are investigated theoretically and through experimental user studies in order to build a comprehensive communication model that deepens our understanding and directs our technical developments towards mediated communication experiences as intensive as life.

Research topics

Human-to-human communication experience: presence, immersion
Human-to-human communication elements: A/V quality, eye-contact, gestures, emotions
3-D imaging: Stereo camera capture and rendering for auto stereoscopic displays
3-D and near-to-eye displays
Spatial/binaural audio
Multi-microphone arrays
Automated 3D reconstruction and fast 3D rendering
Interaction via gaze-tracking
Diffractive optics for efficient illumination and light guiding

Publications

Häkkinen, J., Kawai, T., Takatalo, J., Leisti, J., Hirsaho, A. & Nyman, G.,' Measuring stereoscopic image quality experience with interpretation based quality methodology', Proceedings of 20th Annual IS&T/SPIE Symposium on Electronic Imaging, January 2008

Ristimäki,M., Hämäläinen,M., Turku,J., Väänänen,R., 'A Cross- Platform Audio Signal Processing Environment for Real-Time Audio Algorithm Development', AES 124th Convention, Amsterdam, The Netherlands, 2008 May 17-20

Levola,T., Laakkonen,P., 'Replicated slanted gratings with a high refractive index material for in and out coupling of light', Optics Express, Vol. 15, No. 5, March 2007

Pylvänäinen,T., 'Automatic and Adaptive Calibration of 3D Field Sensors', Applied Mathematical Modelling, 32, Issue 4, April 2008

Järvenpää, T., Aaltonen, V.,'Compact near-to-eye display with integrated gaze tracking', Photonics Europe, April 2008

Salmimaa, M., Järvenpää, T.,'Objective evaluation of multi-view autostereoscopic 3-D displays', SID Symposium, May 2008

Collaborators

Department of Signal Processing and Acoustics, Technical University of Helsinki
Department of Psychology, University of Helsinki
Deptartment of Signal Processing, Technical University of Tampere
Augmented Reality Team, VTT
Human Interface Technology Laboratory, New Zealand
Nanocomp Ltd

Links

Our gaze-tracking development shown at Nokia World 2007

Contact

Martin Schrader, Team Leader

Team Members