ARquatic Live - A CodeKlavier Augmented Reality Experience
Codeklavier’s ‘ARquatic Live’ is an audio and Augmented Reality experience where the live music provides the DNA of the underwater world unfolding before your eyes. Full of speculative, fantasy structures artificially built from L-system rules, ‘ARquatic Live’ superimposes unusual aquatic inspired objects in everyday environments. Whether you attend a live performance or tune in at home for a streamed experience, the juxtaposition from the surroundings with the AR objects will stimulate one’s imagination by highlighting the contrasting beauty of the natural and the unnatural world.
Friday August 27
“ARquatic” at de Kwekerij Hilverum
Times: 16.00, 17.00 & 18.00
Sunday June 13th
“More than just Music” Festival at Toets des Tijds, Amsterdam and in combination with other performances.
Times: 17.00 & 20.00
Tickets available here
The ARquatic app is available for download here for Apple and here for Android. You will need an Apple iPhone SE/6S model (or later) or one of the Android phones listed here. You can also simply follow the link for the app download and try out the demo channel. It is useful to do this in advance in case your phone does not support AR but your tablet does - in which case, we advise you to bring your tablet! If you do not own an AR supported device, a non-AR version will still show visuals on your Android phone.
Our inspiration for working with L-systems comes primarily from its roots in nature and organic growth which we would like to bring to the musical and programming paradigms. Whilst L-systems are already widely used in generative art and music, we are interested in exploring how this simple model can be used by the piano coder to express complex structures and how its rules will shape the pianistic improvisation. Furthermore, Lindenmayer’s work was done here at the University of Utrecht in 1968 and building upon it through artistic exploration, makes the Netherlands a particularly special location for the presentation of this project.
About the technology
The ‘ARquatic Live’ experience is made possible by three key technological elements and stages; CodeKlavier, Lindemayer and Unity.
CodeKlavier: a system that enables the pianist to code by playing the piano. In ‘ARquatic Live’, this pianist is coding with lambda calculus to create numbers. These numbers are then translated into symbols used in the Lindenmayer systems engine.
The L-systems engine is the second element and transforms the symbols into formal grammars defining the starting point and L-system rules. Together these form the L-system trees creating the structures of the AR visual elements which you see.
These structures, along with some characteristics of the piano playing, are then applied to the visuals designed by Patrick Borgeat and rendered in Unity. This is the final step of the technological process and produces the AR visuals which you experience during the show on the ARquatic app.
CodeKlavier was made possible by the Creative Industries Fonds NL and out angel sponsor
The performances in June and August are made possible the Fonds Podium Kunsten Balkonscenes grant
This project was made possible by the Creative Industries Fonds NL and our angel sponsor. Ongoing work is limited to preparations for gigs at festivals and venues that book us for concerts. Do you believe in the project and would like to support us further? please consider “buying us a coffee”. Every little bit counts and we greatly appreciate your support!