type of project: fellow research project

published: 2022





Digitalizing Narrative Spaces

During the fellowship, I wanted to explore the possibilities to establish links between the actions of recipients and an existing narrative that is responsive to the choices and behaviors of the recipients. To do this, I developed a performative application built specifically for AR experiences. I experimented with how AR can be used in these spaces and how it can be can be complemented with physical elements. I combine AR with video mapping and physical computing components. This can create a reactive space that changes through interaction. In order to add a sensual layer to this, I want to work with different different sensory impressions and experiment with audio impressions. I work with surfaces that can be played on and changed by mapped videos. An elevation in the surface can thus be a table, the roof of a car or the surface of a swimming pool, depending on the video overlay. Both large, wide spaces and very narrow, small spaces can be simulated. The AR, the physical computing components and the video mapping are very closely intertwined. In this way they can influence one another and a physical interaction with the memories becomes possible. During the fellowship, I work on building the interactive physical elements and programmed the network setup. I also try to find out which video aesthetics are particularly suitable for mapping different interaction modes of the AR application and and build a technically well-functioning network. My goal is to build a performative event that responds to the activity level and curiosity of the visitors, combining fantastic and realistic elements. Depending on the level of interaction, visitors should be able to experience different narratives of the same story.

How can a workable and inclusive network be installed? Which intersections of digital and physical interactions are interesting? How can a interactive installation also be interesting for those who are a little more on the passive side?

September: Learining, Building Up Structures I took one C# Course on the digital learning platform UDEMY, Setting up the connection between physical computing tools and Unity

  • How to flash an ESP32 from C++ to MicroPython:

Follow this tutorial: Remember to download the ESP32 file here:

  • projects/digitalizingnarrativespaces/start.txt
  • Last modified: 02.01.2023 15:36
  • by Fabian Raith