Multimodal Information Visualization (MIV)

This line of research deals with using cutting-edge technologies, such as virtual reality, augmented reality, and multimodal interfaces based on audio, touch, vision, or combinations thereof to render information in an intuitive, meaningful, and accessible manner. Humans often have trouble imagining complex data, scenes, or environments and most tools to facilitate information visualization are static, 2D, and based purely on visual information. As we experience the world through the combination of multiple senses, generally in a dynamic, 3D nature, our tools to convey information should do the same. The MIV approach used in VEMI provides information using multimodal, interactive 3D techniques that aid in the ability to learn, remember, and conceptualize this information.

Our research in this area has made a particular contribution on the development of maps and visualization techniques that aid spatial learning and navigation for a range of people with and without vision, especially in the domain of indoor navigation (I-space) and the transition between indoor and outdoor environments (OI-spaces).

Relevant Citations:

1. Giudice, N.A., Walton, L.A., & Worboys, M. (2010). The Informatics of Indoor and Outdoor Space: A Research Agenda. Proceedings of the 2nd ACM SIGSPATIAL International Workshop on Indoor Spatial Awareness (ISA 2010) pp. 47-53. ACM, New York, NY.

2. Giudice, N. A., & Li, H. (2012). The Effects of Visual Granularity on Indoor Spatial Learning Assisted by Mobile 3D Information Displays. In C. Stachniss, K. Schill, and D. Uttal (Eds.). Proceedings of Spatial Cognition VIII: Lecture Notes in Computer Science (Vol. 7463, pp. 163-172). Berlin: Springer-Verlag.

3. Nossum, A.S., Giudice, N.A., & Li, H. (2013). Vertical color maps: A data independent alternative to floor plan maps. Cartographica. 48(3), 225-236.

4. Li, H. and Giudice, N.A. (2016). Assessment of multi-level structural and topological properties on cognitive map development in multi-level built environments. Spatial Cognition 2016 conference. Aug. 2-5, Philadelphia, PA, USA.

5. Li, H., Corey, R.R., Giudice, U., and Giudice, N.A. (2016). Assessment of visualization interfaces for assisting the development of multi-level cognitive maps. In D.D. Schmorrow & M.C. Fidopiastis (Eds.), Proceedings of the 10th International Conference of Foundations of Augmented Cognition, Part of HCI International. Toronto, CA. July 17-22 (pp. 308-321). Springer International.

Complete List of Published Work:

E-pubs at: https://umaine.edu/vemi/publications/

Google Scholar: https://scholar.google.com/citations?user=jD95I7EAAAAJ