The digital world and the physical world are becoming tightly enmeshed through user data and its associations, a proliferation of wireless networks, and real-time data feeds in the world around us. The Mixed Reality Experiences team looks at extending the personal content ecosystems and the related personalized experiences to mixed reality environments where the environment itself is used as a ubiquitous content interface, and a versatile storage and retrieval space.
The extended ecosystem has direct applicability in mobile information management and communications, and more generally has potential to revolutionize information access and media consumption. The mission of the team is to provide enriching service experiences meeting people on their terms in their fused physical-digital worlds empowered by socially-defined information and content.
Research topics
- Personal content: public content with a personal attachment and user-created content
- Personal content ecosystems and the associated service experiences
- User experience research on services in personal content ecosystems
- Extension of personal content ecosystems to mixed reality: physical environment as an interface, storage and retrieval space for personal content
- Augmentation of the physical world using mobile devices as creator of new value for both enjoyment and creation
- UI design for a playful exploration of digitally-enriched environments with associative browsing
- User data (content and metadata): gluing the physical with digital with a focus on people, places and time
- Lifelogging as the capture, storage and distribution of everyday experiences and information for people and objects
- Mobile, collaborative, massively multi-user, augmented reality
- Multimodal (photos, video, audio): synthetic representation of the world, delivery of tailored presentations
- Spatial understanding for on-line users, larger simultaneous communities
- Synthetic spaces for spatial and social immersion
- Freedom of self-expression
- Flexibility of interaction paradigms
- Nokia mixed reality environment as a hybrid service platform for 3rd-party content collaboration and mash-ups
Resources
Books
- Pulli, Aarnio, Roimela, Miettinen and Vaarala, Mobile 3D Graphics with OpenGL ES and M3G. Morgan Kaufmann Publishers / Elsevier, 2008.
- Lehikoinen, Aaltonen, Huuskonen and Salminen, Personal Content Experience: Managing Digital Life in the Mobile Age, London: Wiley&Sons, 2007
Demonstrations
Mobile Augmented Reality Applications (MARA) platform
Presentations
SIGGRAPH 2007 Courses: The Mobile 3D Ecosystem (pdf)
Standardization
- JSR-184: Mobile 3D Graphics API for J2ME
- JSR-297: Mobile 3D Graphics API 2.0
Publications
Multisilta, Centers of Excellence in University Research: Empirical Study, R & D Management, 2008
Roimela, Aarnio and Itäranta, Efficient high dynamic range texture compression, ACM I3D 2008
Vaittinen, Laakso and Itäranta, Kuukkeli: Design and Evaluation of Location-based System with Touch UI for Hikers, NordiCHI 2008
Aarnio, Roimela, Pulli, M3G: Bringing 3D Graphics to Mobile Java, ACM Queue
Vaittinen, Viljamaa and Piippo, Design issues related to pie menus for 5-way joysticks, Mobility 2007.
Viljamaa and Vaittinen, Unified media UI structure and design for mobile devices, Mobility 2007.
Viljamaa, Vaittinen and Anttila, Towards an optimal information architecture model for mobile multimedia devices, Human-Computer interaction (HCII '07).
Huuskonen, Run to the hills! Ubiquitous computing meltdown, in Augusto, JC and Shapiro, Daniel (eds.), Advances in Ambient Intelligence. Volume 164, Frontiers in Artificial Intelligence and Applications (FAIA) series, IOS Press. 2007.
Lehikoinen, Lehikoinen and Huuskonen, Understanding privacy regulation in ubicomp interactions, Personal and Ubiquitous Computing, 2007.
Jantunen, Laine, Huuskonen, Trossen and Ermolov, Smart sensor architecture for mobile-terminal-centric ambient intelligence, Sensors and Actuators A: Physical, Elsevier, 2007
Reponen, Huuskonen and Mihalic, Primary and secondary context in mobile video communication. Personal and Ubiquitous Computing, 2007.
Collaborators
- Devices and Interoperability Ecosystems (DIEM), Mobile Mixed Reality (MMR), 2008-2010
- Adaptive Informatics Research Centre, Helsinki University of Technology: Context-specific information retrieval, relevance feedback
- Department of Media Technology, Helsinki University of Technology: Multimodal AR, multimodal interaction
- Human-Centered Technology, Tampere University of Technology: Usability and user experience of mixed reality services
- Virtual Models and Interfaces and Knowledge Systems units, VTT Technical Research Centre of Finland: Mobile AR applications and services, tools for UGC
- Sesca Mobile Software
- Flexible Services, Cross-Media Broadcasting 2008
- Innovation framework for cross-media publishing: which develops solutions for both content and media production with interfaces to user generated content and consumption of cross media services within the field of learning. It includes Finnmedia, AEL, Anygraaf Oy, Finnish National Board of Education, Forssan Kirjapaino Oy, GTTS (Graphic Industry Research Foundation), Itella Group, KCL (Oy Keskuslaboratorio), KSF Media Ab, Logica, Nokia Oyj, Profium, Sanoma/Sanoma Data Oy, Sanoma Magazines Finland, Finnish News Agency (STT), WSOYpro, Yhtyneet Kuvalehdet Oy, TKK, VTT
- eMobility Strategic Research Agenda main editor
Contact
Ville-Veikko Mattila, Team Leader
Team Members
Tomi Aarnio | Tero Hakala | Pertti Huuskonen | Joonas Itäranta | Markus Kähäri | David Murphy | Kimmo Roimela | Tuomas Vaittinen
