Wednesday 9th August –
“Darkness falls
Walking empty corridors
Dusty roads
Seeing things never shown
You and I we know” – Soldier by Particle House
The MACBA Metamorphosis book is available to buy and if anyone would like a copy then please see the barcode at the bottom of this post. However, so that no purchase is necessary, I am including images from the book along with their corresponding augmented reality experiences. This means anyone reading this blog can experiment for themselves and no-one is excluded.
Background Information & A Few Pages from MACBA Metamorphosis
The MACBA Metamorphosis book forms part two of a planned 3 part series that begins with the exploration of Graffiti in the heart of Barcelona. The project enlists the help of Ai to re-imagine this graffiti and digital tools are used to place it on the pristine walls of the MACBA museum. Book one in this series is called ‘Beautiful Light – MACBA – Barcelona’ and more details can be found about it here. This book has already been augmented using a simple iPhone App except with limited functionality. However the results can be seen in the video below.
The 21 Day Challenge has been about further exploring augmented reality, discovering the most appropriate tools, increasing the complexity of augmented experiences and fully augmenting book 2 in the series namely MACBA Metamorphosis. Below are some of the pages from the book.
A Selection of Stills from the MACBA Metamorphosis Book
In order to access the augmented reality experiences slide the image slider to fully reveal a QR code. Use the camera on a smartphone and point it at the QR code to access the link that automatically pops up. This link will then lead to the experience. Please follow the onscreen instructions from there. Normally there will be a prompt asking for the location of a specific image. This time use the slider of the QR code that has just been scanned, to fully reveal the requested image. On passing the onscreen image over the corresponding QR code’s image, the augmented reality experience should be launched.
Sometimes a slow internet connection can impede functionality and in some cases the augmented reality experience may not work as expected. I found this was a common problem with all of the software that I trialled. In order to mitigate this I have made short videos to accompany each QR code and locator image to show what should actually happen in the event things don’t work as they should. This way the viewer can still enjoy the intended outcome. I have also included a link to each augmented reality experience just in case there are any unforeseen issues with the QR codes.
Please note: Slow internet connections can negatively impact the augmented reality experiences. In the unlikely event that an augmented experience fails to load, a video of each augmented reality experience has been added to show how it should work. This is so everyone can access the augmented pieces at some level.
MACBA Metamorphosis an Alternative Reality
Page 1
The first augmented reality page of the MACBA Metamorphosis book shows the word ‘Graffiti’ gently moving around the page. The book itself is about the mix of ai re-imagined graffiti along with the beautiful crisp clean interiors of the MACBA museum in Barcelona. The simple word ‘Graffiti’ was used to set the scene. This page had two challenges – firstly to produce a gentle colourful animation of the word ‘Graffiti’ and secondly to import that animation into the augmented reality software with a transparent background. The tools used for this page included: ChatGPT for ‘Processing’ code requirements, Adobe After Effects for background removal and Adobe Photoshop for the export of transparent.png files. This whole page involves a complete human hybrid mix to bring the piece to life.
There is a complete human hybrid mix to this page which is as follows: human concept, human graffiti and human photography alongside ai re-imagined graffiti and ai data driven programming. This was then mixed with digital tools that were human driven. The final piece has been hidden within the page one of a physical book. The concept of both human hybrid art and hidden things, I think aligns well with my study statement.
QR Code Not Working? Please use this LINK
Page 2
This page is dedicated to bringing an image of ai-reimagined graffiti to life. Again there is a strong human hybrid mix to this page/piece very similar to that found in page 1. The fluid motion behind the ai reimagined graffiti is reminiscent of a fluid transition from the physical to that of augmented reality, once the image is found inside the MACBA Metamorphosis book.
QR Code Not Working? Please use this LINK
Page 3
This page concentrates on process and behaviours within the augmented reality software. As with pages one and two (and indeed throughout this whole project) there is a strong human and ai mix of working. However, the focus of this page is movement and scaling. The ai-reimagined graffiti has been warped and moves in a fluid motion. All of the colours from the original image have been used to create this piece. In fact the program written to create this piece requires an original input image in order to work. The image also gently scales back and forth allowing the viewer to examine the colours more closely. Computer resource problems only allowed for scaling on this piece but it is a nice example of a simple function in augmented reality.
QR Code Not Working? Please use this LINK
Page 4-5
The active augmented reality image on pages 4 and 5 is actually page 5. This page sees the introduction of a 3d object. I used a ‘Touch Designer’ data mosh program to slowly destruct the ai re-imagined graffiti image. I also chose a robot (symbolic of ai) to do a little circular dance when tapped. The tapping is not disclosed to the viewer and this is left to be discovered. It is a hidden behaviour of the robot. Please try tapping the robot to discover the hidden motion. I specifically aligned the 3d robot with this image and the augmented reality data mosh. This is because when tapped the robot appears to do a ‘happy dance’ as the original image (physical reality) destructs before it’s eyes.
Although this page/piece was very much about learning a process namely importing 3d objects, I still wanted some level of thinking to be involved. Once again this page reflects the hidden – the hidden behaviour of the robot by a tap. It also represents a strong human ai mix. The 3d object was created using ai.
QR Code Not Working? Please use this LINK
Page 6-7
Out of pages 6 and 7, it is actually Page 7 that is the active augmented reality page in the book. This page shows the simple dissolving of the original physical image on the page, as a strong and sturdy looking robot keeps guard. Again this scenario has meaning. It represents a dystopian vision where our physical world slowly disintegrates in the face of an ai takeover. It is a naive and childlike concept, yet one that is actually preying on some of the greatest thinkers of our times.
QR Code Not Working? Please use this LINK
Page 8-9
Page 9 is the active augmented reality image across the page 6-7 spread in the book. It represents pure experimentation with an augmented reality character that chases a ballon. The image of a room was generated by ai from a digitally produced composite. This composite was made up from a clean white walled room at the MACBA Museum coupled with ai reimagined graffiti that was then again fed through an ai system. I wanted to keep the scene simple. A computer generated 3d animation chases a ballon around a completely ai generated room that was derived by human physicality and thought.
QR Code Not Working? Please use this LINK
Page 10-11
Page 10 is actually the active augmented reality page across the page 10-11 spread. This is yet again an example of pure experimentation with a 3d character animation. There are no hidden behaviours associated with this animated robot. I specifically chose this character as it is a happy robot going about its daily exercise regime. It is standing in front of a an ai re-imagined graffiti clad space in the MACBA museum. It made no sense to alter or destruct this scene as the intention is to have a happy robot enjoying its ai decorated space.
QR Code Not Working? Please use this LINK
Page 12-13
Page 13 is actually the active page in the book across the page 12-13 spread. Yet again more experimentation with 3d animation. This time a toy helicopter flies around in the scene. Perhaps it is on a rescue mission? The background is a depiction of the original image that has been reproduced multiple times. It compounds the idea that ai is everywhere. A room that has been decorated with ai re-imagined graffiti and multiplied many times over. The animated background was created in Touch Designer.
QR Code Not Working? Please use this LINK
Page 14-15
Page 14 is the active augmented reality page in this spread. It is the same image as page 1. Please see page 1 for an explanation of this image.
QR Code Not Working? Please use this LINK
Page 16-17
Page 16 is the active page in this spread. A pixel sorting program was created to district the ai created and graffiti filled room. A single augmented reality plant resides unchanging in the foreground. It serves as a constant to the ever changing and destructing background. This page is yet another example of a complete human hybrid mix. The image on page 16 was an amalgamation of human concept and photography mixed with digital art and fed through ai. Again it has all been hidden within the pages of the MACBA Metamorphosis book.
QR Code Not Working? Please use this LINK
Page 18
Page 18 is an example of augmented reality programmed behaviours. In this scene, namely an ai generated graffiti clad room, the image yields a set of colliding circles or spheres. Not only do the spheres move they also scale and end up circling around a pivotal point on the original image. The colours of the circles/spheres are completely dictated by the input image making a direct link to the original. This was a purely experimental page looking at different behaviours.
QR Code Not Working? Please use this LINK
Page 19
Page 19 was pure experimentation with 3d objects. I wanted to produce my own 3d objects. I also wanted to cover these 3d objects with my own materials and textures. To do this I used a combination of Blender software. I animated and coloured the cubes in this piece using Blender and I then augmented the cubes to the ai generated room on page 19. This has opened up a whole range of possibilities.
QR Code Not Working? Please use this LINK
A better version showing more of the cubes can be seen below
Page 20-21
Page 20 is the active augmented reality page on this spread. I used a Touch Designer image revealing program that I amended. This was to enable a full layer of augmented reality to reveal itself on top of the ai re-imagined graffiti image. The image slowly reveals itself covering the original image, showing that there is a hidden layer to everything – it’s just waiting to be discovered!
QR Code Not Working? Please use this LINK
Page 22-23
Page 23 is the active page in this spread. The augmented animation begins to slide like paint down the screen. At certain points in the animation the colours are very vibrant and beautiful. I hope to show that actually there is a hidden beauty in these destructive programming techniques. There were no behaviours assigned to this augmented reality animation it was there purely to show a layer of colourful vibrancy that moves beyond the static image.
QR Code Not Working? Please use this LINK
Page 24
Page 24 is the penultimate image in the book and ironically this page isn’t tagged to augmented reality. Instead it’s colours are used in this piece.
I wanted to explore a horizontal placement and created a larger experience for the viewer. Therefore, the image on page 24 does not need to be located instead a pin determines where the experience starts.
This piece is about a layer of reality that is autonomous, it surrounds us, but without the correct knowledge or ‘key’ it is ultimately hidden in space. Hidden in the ether yet again just waiting to be discovered.
QR Code Not Working? Please use this LINK
Back Cover
The back cover uses a complete mix of a Ai data driven program coupled with Ai reimagined graffiti and blended together using Adobe After Effects and Adobe Photoshop. It is the culmination of 21 days of continuous exploration into the whole world of augmented reality and Ai. The back cover sets the scene for continued experimentation with human interaction coupled with augmented reality and Ai tools. A book 3 is planned for later in the year and this will further explore designs derived from the simple notion that human graffiti and the hidden artists behind it deserve to be recognised.
QR Code Not Working? Please use this LINK
A Selection of Additional Augmented Reality Video Shorts
As well as the augmented reality videos above, I carried out a number of AR experiments using a wide variety of AR software. Below are some of these video shorts which I worked on over the 21 Day Challenge.
Evaluation & Conclusions
At this stage the series of three planned books is far from finished. A third book still needs to be designed, printed and augmented. However, the act of a 21 day challenge has significantly helped to move this project forwards.
During the 21 day challenge I made some significant discoveries about AR (augmented reality) software. I discovered that there was no ‘one size fits all’ out of the box solution to meet every need. Indeed even with my chosen augmented reality program I still had to make a number of compromises. I plan to do a short synopsis about the advantages and disadvantages of each augmented reality software app and or program that I tried. I will do this at the end of the project as it could prove useful for anyone who would also like to take this journey into the fascinating world of AR.
I acknowledge that the augmented reality pieces that I created were not highly sophisticated. This was not due to lack of ability to knowledge on my part, rather lack of computer resource. However one great thing about the way in which the software works is that I can build upon the foundations already laid. As soon as I replace my ailing MacBook, I will be able to revisit each augmented reality experience that I originally created and add to it. I will be able to add additional behaviours, animated text descriptions, extra animations and much more. My 21 day challenge allowed me to gain the knowledge that I need to do this it is only lack of computer power holding everything up.
I discovered, what I believe, is a novel creative and artistic use of AR, and I am looking forward to perfecting this technique. Once the third and final book is completed I intend to move the project forward in this direction. I am pleased that this project seems to align quite well with my study statement. I am creating things that are not only hidden from view, but I am also developing a human, Ai hybrid mixed way of working. I am producing pieces that incorporate a full range of human, Ai and digital activities that meld together to create my final pieces.
Part of the inspiration for exploring augmented reality came from an app I discovered many years ago. This app allowed for the user to hide hand written messages on walls. It came out around the time of the famous Pokémon Go augmented reality game.
However, perhaps my greatest influence was the work by Guillermo Lorca in Barcelona’s MOCO Museum. I wanted to work out exactly how he had managed to so beautifully augment his work. I can honestly say that after 21 days of sustained effort I now know. In fact I am confident that I could produce a similar experience with my own works as soon as I obtain the computer resources to do this. The 21 day challenge has been an amazing journey. I’ve managed to answer pretty much all of my unanswered questions relating to augment reality and I’ve explored a wide variety of software packages in the process. I intend to document these findings as soon as I can in case anyone else would like to experiment with this fascinating medium. In the meantime please see below for an example of Guillemo Lorca’s augmented work.
On a final note I want to draw attention to the lyrics at the top of the page. I felt that these particular lyrics worked well with what I was trying to say. I am working with ‘things’, as in the words of the song ‘never shown’. However ‘you and I we know’ – you the reader knows that there is an alternative reality wrapped up in my books but to others this is ‘never shown’, unless of course they are invited to know.
Copies of the Books Seen in this Project
Below are barcodes which link to the first two books in this 3 part series.
Book 1 – Beautiful Light – MACBA – Barcelona
Book 2 – MACBA Metamorphosis – Changing Spaces
