type of project: fellow research project

published: 2021

by: Jana Kerima Stolzer, Lex Rütten

website(s): www.thisisinternet.de

license(s): MIT

maintainer(s)/contact: hello@thisisinternet.de

visit Episode 02 here: https://hubs.mozilla.com/oLqLyhv

Pawāaraibu - filling the vacuum

slightly windy undulations - deep turqoise - altitude 2557 meters - weather conditions: sunny - We left the earth as we consumed it and explored new places from then on - with the promise of preserving this world as a museum to learn about flora, fauna and their evolution. Pumps powered by different kinds of energy ensured the balance between land and groundwater. Artificial creatures provided minimal maintenance while archiving their environment. All this for the overarching plan of constructing a surveillance tool to observe that evolution from afar: For those who would miss the Earth and for those who might be interested in learning from its progress. However, we looked ahead and moved towards the future. Left behind is the view through the eyes of a being who documents and archives this promise of eternity.

Pawāaraibu - filling the vacuum tells the story of an artificial intelligence in several episodes, which travels around in the body of a small drone as one of the last living beings on the post-human earth. We constantly experience the environment through its eyes, within its own language it conveys thoughts and impressions. It shows the Earth as a conglomerate of nature, remnants of human intervention, and to date modern technology that provides maintenance. Prequel and Episode 01 - pumps n' lungs exist as a video and tell of the moment of archiving on earth. Episode 02 - wandering the archive, which was created at the Academy for Theatre and Digitality, travels to an environment without time-space mapping. We are inside the drone's head, wandering through its archive of processed data, which consists of fragments of the previous world. These remaining excerpts stand as a proxy for that forgotten history lost in brutal landscape inscriptions caused by exploitation of earthly resources.

Link to Prequel: https://vimeo.com/463361136/421374c5b7

Link to Episode 01: pumps n' lungshttps://vimeo.com/468963231/0fbe5cae08

Lex Rütten and Jana Kerima Stolzer are an artist duo working together since 4 years. The starting point of their installations and performances is often shaped by the link between human being, its technological environment and the resulting emotional challenges. In the past the duo realized scenic installations and performances at the interface between exhibition space and theatre space.

How can a drone help to archive our environment? Is it possible to perceive the environment through the eyes of a machine? How can stories be told by a machine so that the empatrhic moment is not lost? And doesn't the machine serve as a repository of human history when nothing else remains? Can we collect memories within data in form of 3d models through which we travel? Goal: creating scenes where the drone is protagonist, mediation of the story through songs

  • - processing images and sound through a machine
  • - archiving landscapes and architecture with the help of a drone
  • - make that collected data accessible in a way that it tells stories
  • - creating 3D models out of the data which was collected
  • - composing songs and feed the synthesizer with it-
  • - creating scenes and sounds for scenes (spatial sound)
  1. research: artificial intelligence in application, logistics and infrastructure, machines and renaturalisation of former industrial areas, drones in application, sci-fi stories and movies, empathy and machines
  2. creating the concept: writing a story, searching for images, first sketches for songs
  3. story research: where to film: former industrial areas, current industrial areas: mining pits, renaturated areas
  4. technical realisation: choosing platform mozilla hubs after tryouts in VR, processing images - learn how to process videos and images in 3D models
  5. writing and creating scenes and texts for the scenes
  6. composing music and songs

To do your own archive scan of the environment you need:

  • a drone (which can carry more than 300 grams)
  • a saddle for the drone, means a mount for a 360 degree camera
  • 360 degree camera (a small one)
  • PC with good GPU and CPU
  • software to process images and videos to 3D models. (there are different ones, for this project we used pix4d)

Pawāaraibu - filling the vacuum, Epsisode 02 has its place in mozilla hubs. Its an easy accessible virtual space which you can enter via VR glasses or via desktop browser. Every scanned landscape can be archivated in mozilla hubs. Afterwards you can travel through via glasses or browser.

  • search for places, objects or areas you want to archive
  • take the drone with you, search in the internet for a fitting mount for the 360 degree camera - connect drone and camera via the saddle
  • start to record the choosen area. important: try to film everything. you don't have to be that close to objects, choose a good flying route
  • if you want to archive objects like architecture (churches, houses etc) you can use the camera of the drone to take photos. Be aware of taking a photo of really every corner of the object. You need overlapping infos on the photos.
  • we recommend to do the 360 degree filming - its faster
  • when you got the footage, extract the images of the video. It's enough to take every 30rd image.
  • put the images in your processing software - it takes a long time.
  • the output is a pointcloud of your 3D model
  • if it doesn't work the first try, choose different flying routes and distances for better models
  • load your 3D model / object in via spoke in mozilla hubs and make it accessible for everyone.

drone in reality / model of reality

  • projects/metrodronis/start.txt
  • Last modified: 28.01.2021 14:54
  • by Philipp Kramer