2023 | Companion Proceedings of the Annual Symposium on Computer-Human Interaction in Play

Stackable Music: A Marker-Based Augmented Reality Music Synthesis Game

An illustration of stacking transparent AR markers and photos of the Stackable Music application. When multiple transparent AR markers are stacked and recognized by the camera, the application takes them as input and generates a variation of jazz.

Abstract

Augmented reality (AR) allows the rendering of digital content on top of the physical space, which is a promising medium for tangible interaction. Marker-based AR is widely used thanks to its low cost and ease of integration, but the gameful aspect of manipulating the physical AR markers remains understudied. In this paper, we explored the stacking mechanics of transparent AR markers and described the creation of an AR music game called Stackable Music. Stackable Music can be developed, assembled, and set up at the home or office with a printer using several sheets of transparent film and a PC or mobile device with a camera.

BibTeX

@inproceedings{Chen2023Stackable,
  author = {Chen, Max and Liang, Shano and Smith, Gillian},
  title = {Stackable Music: A Marker-Based Augmented Reality Music Synthesis Game},
  year = {2023},
  isbn = {9798400700293},
  publisher = {Association for Computing Machinery},
  address = {New York, NY, USA},
  doi = {10.1145/3573382.3616071},
  booktitle = {Companion Proceedings of the Annual Symposium on Computer-Human Interaction in Play},
  pages = {22–28},
  numpages = {7},
  series = {CHI PLAY Companion '23}
}