Semantic Graphics and Interactive Visualizations
Researchers:
Agathe Battestini, Vidya Setlur, Xianghua (Sharon) Ding (Intern from UC Irvine)Introduction
Computers are becoming faster, smaller, and more interconnected, creating a shift in their primary function from computation to communication. This trend is exemplified by ubiquitous devices such as cellular phones with cameras, personal digital assistants with video, information displays in automobiles. At the same time, progress in networking and storage technologies facilitates large quantities of media to be captured and provided whenever desired. Rapid advances in technology allow computer screens to be filled with complex information at real-time rates. Simulations that once required supercomputers are commonly run on desktop applications. While the computer industry has produced faster processors, larger disk drives, and higher memory capacity, these advances do little to help people understand the meaning and representation of data. This lack of understanding stems from the fact that machines process data in numerical form, while humans comprehend visual data more easily. In addition, producing effective and expressive visual content currently requires considerable artistic skill and can consume days. As computer graphics matures and finds wider scope for applications, its success must be defined in increasingly human terms. Firstly, graphics imagery must be effective for human viewers and visualizations must bring about understanding. Secondly, the man-made artifacts in that imagery must reflect human activity and practice: Addressing both of these challenges involves finding solutions in problem spaces more complex and with fewer constraints than typical for graphics researchers.
Some sample images from our research:
- Fig 1: Developing automatic design methods for designing and customizing a variety of personal information type of visualizations for mobile data. In this case, the personal mobile data are SMS messages.
- Fig 2: Using context based icons for directed search tasks for both desktop and mobile web navigation.
Research Agenda
Our goal is to study the semantics, usage and serendipitous nature of this heterogeneous mix of information so that it can be presented to the user in an intuitive manner in the form of interactive visualization based services. A semantic understanding of data is crucial for integrating data from diverse sources if the structure of the data is unknown or more generally if the data is unstructured. Image tagging, already widespread on sites such as Flickr and Facebook, is an example of the power of the application of semantic data to images. New algorithms in semantic graphics, i.e. is the study of graphics expressing some underlying linguistic meaning, are a key element in establishing dominance in this emerging sector. Currently, we have been exploring the potential of semantic graphics to create new value propositions in bridging the mobile with the Web. Although more and more people rely on their mobile devices for viewing, collecting and capturing data, the value propositions of such data have not been well understood.
The objectives of this research project is to develop new algorithms and user interfaces that enhance visual communication, while making it fast and easy to generate compelling content. The research combines concepts and methods from visual art, perceptual psychology, information processing and cognitive science to facilitate users in creating, understanding, and interpreting visual information.
Back to the main team page.
