DENTSU CREATIVE X INC., Tokyo / YAKUSHIMA TREASURE / 2022
Now is a time when we are limited in our ability to feel the physical presence of other people or to even go outdoors. YAKUSHIMA TREASURE was looking for a way to deliver its music.
However, they thought it would be difficult to surpass the quality of a live performance by simply distributing video.
We were required to create a completely new shared experience of live performance that was different from the real live experience, and different from the streaming live video experience of the past.
This work allowed audiences to experience an entirely new way of taking in a concert that is different from both regular video captured with a camera and from a scene observed with the human eye.
Rather than recording video of this musical performance about the cycle of rebirth, we captured a world "seen by spirits" in the form of data.
“ANOTHER LIVE” offers an interactive, browser-based experience to view the latest live performance by YAKUSHIMA TREASURE in the virgin banyan forests of Yakushima.
Unlike a spectacle you would view with the naked eye, and unlike a video recorded with a regular camera, the experience provided by this work is an entirely new way to take in a concert. It is a live performance reconstructed from a combination of different perspectives on the world: a space scanned as 360-degree 3D point group data with infrared light, colors captured with photogrammetry, movements recorded with depth sensors and audio image from the concert recorded in surround sound from all directions with 360-degree microphones.
We recorded their live performance in Yakushima using a variety of technologies.
Space: 360° LiDAR Scan
The entire forest was scanned as 3D point cloud data with a LiDAR sensor.
Colors and textures: Photogrammetry
Photogrammetry employing over 1,500 high-resolution photographs enabled expression of colors and texture as though from a painting.
Motion: Volumetric Video
Nine depth cameras were used. They recorded 3D data that captured absolutely all of the movement and expression from a one-time-only performance.
Sound Field: Spatial Audio
360° microphones in a surround sound system using eight speakers recorded the audio.
The live performance, reconstructed from the recorded data, is exported with color/depth/camera information and can be viewed on the website.
In this way, there are no physical constraints on camera angles, and viewers can get so close to the artist that the distance between them disappears, fly around in the forest, and watch the performance from any perspective.
Furthermore, by using WebGL to process the data of color, depth, camera information, and other viewers' perspectives, real-time data can be synthesized into the pre-rendered video space without any sense of discomfort, making it possible to experience the live performance while feeling the presence of other viewers.
On the website, the dynamic camera work of PointCloud, the gothic typography that reminds us of people's historical years, and the fine lines that constantly change shape and waver express the reincarnation of life and the dynamism of life felt from the nature of Yakushima.
The ideas and craft of our creative house Tokyo and Koichiro Tsujikawa take YAKUSHIMA TREASURE’s uniquely vivid perspective of the world and elevate it to a new level in the form of a beautiful viewing experience. This work enables an entirely new way to experience a concert.
This live performance was played in 123 countries, and we believe that it was the best measure we could have taken to help spread the music of YAKUSHIMA TREASURE around the world.