A DEEP LOOK INSIDE PAINTINGS

A video artwork which invites to an imagination journey through the hidden third dimension of paintings.

Light and space is the origin of everything, the two gametes which engendered the Universe. Likewise, in the painting as a window to the Universe, the space becomes canvas and the light emerges in the form of colorful pigments. Somebody said once that the painting is just that, light and space. And it is still mysterious how a canvas and a bunch of pigments can condense the deepest corners of the human soul. I don’t remember when I started to be deeply fascinated by paintings. Recently, I discovered that a neural network could estimate depth from a single image and instantly dreamed about the idea of having a deep look inside the Meninas’ room.

A Deep Look Inside Paintings is a video artwork which invites to an imagination journey through the hidden third dimension of paintings. The depth embedded in a 2D canvas by means of the conferred painter’s perspective is not only unfolded, but also a 3D space is created here to navigate through, from which a whole new vision of the painting arises. In this process, the rendered inaccuracies only contribute to the drama and the beauty of these paintings. The electronic textures in The Debussy’s Clair de Lune, as magic powders, confers life to the audio-reactive canvases by connecting both classical and actual digital worlds.

One of the evolutionary strategies to understand depth in monocular vision, which means looking through a single eye, has to do with the ability to (visually) remember that size decreases with distance. Actually, size-scaling was one of the first strategies which painters used to give perspective to their paintings. Nowadays, deep neural networks for computer vision have been trained with so many images, that in the end they are also able to learn what should be near and far in the scene. Megadepth, a deep learning-based model trained with thousands of depth maps estimated from manifold tourist pictures of city landscapes, is one of the SoTA methods in generating depth maps out of a single image. It truly fueled this artwork. Everything else is just an emotional flame.

- Diego Velázquez, “Las meninas” (1656).
- Francisco de Goya, “Los fusilamientos” (1814).
- Jean-François Millet, “L’Angélus” (1859).
- Edgar Degas, “Répétition de ballet” (1873).
- Georges Seurat, “Un dimanche après-midi à l’Île de la Grande Jatte” (1886).
- Pablo Picasso, “Mujer en azul” (1901).
- Ramon Pujolà, “Salamanca” (2018). Follow him at ramon_pujola.
- ROLI: Debussy’s “Clair de Lune” cover.
- Rafael Redondo: all the rest (3D renders, audio-reactive animations, additional synthetic sounds, and video editing).

Further details and digital material at A Deep Look Inside Paintings.
To render these 3D models check DepthPainter out.

Feb, 2019.

FINESTRES 4.0

An interactive journey for X Mostra Sonora i Visual at CC Sant Agustí.

A windowed landscape opens in front of us. Temporal windows showing multiple times of the same place. A place where people see each other at the same point in the space-time, the same point in history, a surprising connection between landscape and its actors.

This installation offers an experience to the visitors to connect multiple realities in our neighborhood through interactive sonic windows that show us different moments of time in a location. We speak about four dimensions, three-dimensional space plus another dimension of time. The installation proposes to explore everyday use that as neighbors we do at our streets, shops and public spaces, and even the space transformation we provoke with our stories, customs and coexistence.

In an immersive space with sound and original music, visitors activate windows by their movements and gestures that animate photographs' fragments of urban landscapes and reproduce sounds processed in real time. The pictures, sounds and soundtrack recordings are field recording specifically captured for this installation. The movements are detected by the Kinect depth sensing device. With this technology the installation provides simultaneous interaction of multiple actors who may collaborate in the exploration and even joint to the creation of sound and visual landscapes.

- Visual programmer: Rafael Redondo
- Sound composer: Corrado Scanavino
- Photographer: Elizabeth Xospa
- Technology: Openframeworks, Openni-Nite + Kinect, reflex camera, stereo audio recorder, FullHD projector, Mac mini 10.11 OSX.

June, Barcelona 2016.

Finestres 4.0 Finestres 4.0 Finestres 4.0 Finestres 4.0 Finestres 4.0 Finestres 4.0 Finestres 4.0 Finestres 4.0

ELS 5 ROSETONS DEL TEMPS

An interactive mapping for Recorreguts Sonors at CC Sant Agustí.

The rose windows of the Sant Agustí Convent are a symbol of 500 years of history. They are a porthole through which one can peer into the present and past to discover the story behind the convent and the La Ribera district. The story tells about the people who used to play there, the people who danced and fought, who loved, won and lost.

As visitors move through the cloister they are detected by a fisheye webcam. Their movements generate falling crystal particles that activate the rosettes when many of them fall on. The technology is shown here as a tool to not forget our history and therefore our origins.

Tv clip from Àrtic (bTV).

- Author and developer: Rafael Redondo
- Photo: Elizabeth Xospa
- Design: Rodrigo Núñez
- Sound design: Zenjiskan
- Producers: Kenchan Onaga
- Technology: Openframeworks, HD camera web, 2 projectors XVGA, Mac mini 10.11 OSX.

Novemeber, Barcelona 2015.

Setup Els 5 Rosetons Del Temps Setup Els 5 Rosetons Del Temps Setup Els 5 Rosetons Del Temps

INTERACTIVE 3D PHOTOSHOOT

TopCiencia Cosmocaixa Museum.

Faced to the screen we are recognized through our body and hands. Then immersed in a 3D space, we are able to activate virtual buttons and manipulate 3D objects related to three different scientific professions (an atom, an ADN chain and the planet Earth). The virtual objects are projected scaled and rotated as much as our two hands are separated and turned. While we just play with them, a reverse count will begin and a remembering picture of our visit will be taken. Then we navigate through a virtual keyboard by typing our email that will send us the souvenir and it will thank the visit.

This installation is part of the 'Top Ciencia' exhibition opened permanently on 2014 by the Cosmocaixa Science Museum of Barcelona.

- Coding: Pelayo Méndez and Rafael Redondo
- 3D Design: Sergi Espada
- 2D Design: Optimus Medina Riley
- Videoclip music: Zenjiskan
- Promoters: Fundació La Caixa & VR Reality
- Technology: Openframeworks, Openni-Nite + Kinect, full HD screen and webcam, Windows 7.

- Press news:
- Digitalix
- IrsiCaixa
- Barcelona TV (btv)
- Barcelona Cultura

April-June, Barcelona 2014.

Cosmocaixa Top Ciencia Cosmocaixa Top Ciencia Cosmocaixa Top Ciencia Cosmocaixa Top Ciencia

M.U.R.S. (La Fura dels Baus)

Theatrical parody of the technological excesses of Smart Cities.

The show MURS by La Fura dels Baus offers a criticism or parody of the technological excesses of Smart Cities. The audience arrive having preinstalled an app, which acts as the main driving force as well as one of the central characters of the show.

MURS is divided into 4 rooms through which the audience move around freely, either following orders from the actors, from the multimedia content they receive on their mobile phones, or the instructions given on the video screens placed in each room. The show also offers the spectator different interactive installations related to the use of new technologies.

Due to its complexity, various companies carried out the technical development of the project. My studio was in charge of designing and developing the interactive part as well as carrying out the technical and artistic direction: a role that bordered the technical development as well as the visual creation and play writing of the show.

- Original concept and y production: La Fura dels Baus.
- Artistic Direction: Carlus Padrissa, Pep Gatell, Pera Tantiñà and Jürgen Müller.
- Musical Director: La Fura dels Baus and Carles López Campmany.
- Interactive Design: Pelayo Méndez.
- Coding: Pelayo Méndez and Rafael Redondo.
- Additional coding: Glen Fraser. Video design: Tigrelab.
- Network: Iglor Soluciones audiovisuales, S.L..
- APP Development: Inqbarna.
- Making-of: Sara López and Nico Di Masso.

July, Barcelona 2014.

CLOCKWISE THOUGHTS

Digital artwork inspired on recurrent neurotic thoughts.

Our mind, made of thoughts, thoughts everywhere, thoughts going forward, coming back, spinning, falling, jumping,... we can't stop them, they flow like seconds in a clock and somehow organized to conform what we finally are: human beings. This artwork is an expression of my thoughts, from the very first one to the current ones till the end of my days, thinking things...

Have a nice trip!

Programming, design & music by Rafael Redondo Tejedor (Vali).

Code here: github.com/valillon/ClockwiseThoughts

TOnOa MUSIC

Musical app for kids to improvise with interactive soundtrack sounds.

Enjoy improvising music by playing around with bubbles! Made of colored shapes, movements and sounds, TOnOa Music wants to motivate the interactions in the early years of life. But no matter your age, you will have fun musical moments too!!

1. SOUNDTRACK: pick a song from the list. You can add your own songs too (available in full version).

2. INTERACTIVE MODE: the bubbles make fun sounds. Switch it ON and bubbles will play key samples taken in real-time from the soundtrack. It is also listening to you!

3. PUSH PLAY & ENJOY: multitouch designed, let's play together!

Big thanks to developers community of Libpd, Openframeworks and iOS SDK.


- Author, programmer, designer and music composer: Rafael Redondo.

This project has been discontinued. Visit the website.

Barcelona 2013-2014.

TOnOa Music on Internet TOnOa Music on Internet TOnOa Music on Internet TOnOa Music on Internet TOnOa Music on Internet