Challenges and Opportunities in Combining Physicalization with Augmented Reality: an exploratory case

Abstract

Data is the new “natural resource” of the 21st century. Recent years have witnessed its rapid expansion, increasing the production and availability of data. In this context, there are still significant challenges to fully realizing its potential, especially to make it accessible and more useful to the larger public. Considering design as an activity of cultural mediation and since “data has no naturally corresponding form”, we detail the process and challenges involved in combining different artifacts to support data visualization and exploration. “GRAC” combines a physicalization (physical object embedded with data) with an augmented reality application, enabling users to explore two datasets related to design education and design companies in Portugal. The artifact was tested with 21 people at the DesignOBS exhibition of the Faculty of Fine Arts of Lisbon and Porto. Based on participants’ feedback, we draw design implications for artifact integration; and propose future research directions.