In September 2023, the Noh event “Nikkei Noh” was held in Paris highlighting Nikkei's fusion of a traditional Japanese Noh play with AI-generated animation. This event showcased a reimagined Noh play titled 'Funabenkei' through a 10-minute AI animation using image generative AI models. We utilized Nikkei's proprietary data to fine-tune and develop unique style-adjusting models on cloud environments. This approach successfully combined historic culture with modern technology, attracting over 5,000 viewers, enhancing cultural exchange, and significantly boosting Nikkei's brand recognition and reputation for innovation in the realm of entertainment technology.

In September 2023, the "Nikkei Noh" event in Paris marked a significant moment in blending traditional Japanese performing arts with modern technology. Nikkei transported an authentic, full-scale Noh stage from Japan to Paris, emphasizing the rich heritage of Noh, a revered Japanese art form with a history spanning over 600 years. This event featured a performance by a renowned contemporary artist, aiming to create an unparalleled brand experience on an international stage.

The highlight of this event was the innovative fusion of the ancient art of Noh with Nikkei's latest AI-generated animation technology. The classical Noh play 'Funabenkei' was reimagined through AI, transforming it into a captivating 10-minute animated format. This AI-driven interpretation offered the audience a unique, emotionally engaging experience, showcasing a harmonious blend of tradition and modern innovation, and underscoring Nikkei's commitment to bridging historical art forms with cutting-edge advancements.

In crafting the animation, paramount importance was given to honoring the heritage of Noh, recognized as the world's oldest performing art. Essential to this process was the guidance of a Noh master, ensuring the animation's authenticity. This guidance was critical for accurately replicating traditional Noh costumes and settings, as well as for the precise portrayal of movementsa, with a focus on maintaining fidelity to the art form. Additionally, the use of generative AI raised crucial legal and ethical considerations, notably copyright issues. To navigate these challenges, Nikkei pioneered its own unique AI for animation generation, exclusively employing proprietary materials. This approach facilitated the successful realization of the project, enabling a faithful representation of traditional Noh in a novel format while adhering to legal and ethical standards. The project stands as a testament to the seamless integration of deep respect for traditional performing arts with the advancement of cutting-edge technology.

The innovative essence of this project was in reinterpreting traditional Noh through the lens of modern media and technology, transforming it into an animated format. This approach allowed the timeless beauty and narrative of Noh to be accessible to audiences unfamiliar with the Japanese language, broadening its appeal. By leveraging generative AI, we showcased our commitment to harnessing technology and innovation in order to bring a classical performing art to life in a new, visually captivating way.

Great care was taken in authentically replicating the intricate costumes and settings, as well as in accurately depicting the performers' movements, reflecting a profound respect and understanding for the art of Noh. Additionally, the creation of a comprehensive video content exclusively using generative AI is a rarity in the field, positioning this project as an exceptionally advanced and creative endeavor from a technological perspective.

August 22, 2022: Image generation model, ""stable diffusion,"" is released.

October 1, 2022: Research on image generation AI by Nikkei researchers begins.

June 15, 2023: Successful practical application of video generation.

July 10, 2023: Decision to create animation for Nikkei Noh performance.

August 5, 2023: Animation production begins.

September 19, 2023: Final delivery of the animation.

September 22, 2023: Broadcasting of the animation in Paris.

Production began in the summer of 2023 by researchers at Nikkei. This process involved extensive research on related papers and the development of models and workflows for the creation of animation. The field of AI-generated animation is constantly evolving, presenting new challenges in finding feasible approaches while new research papers and implementations are appearing daily. Specifically, a model based on image generative AI models was fine-tuned using Nikkei's data to develop unique style adjusting models. An environment for image generation and model training was established on the GCP. For image control, the conditioning technique was adopted, allowing for the creation of images that are composed from various reference images.

Subsequently, key points extracted from animations created with simple 3D models were used to transform images into an animated style. A workflow was established, and these images were appropriately combined to produce a coherent animation. The use of generative AI in animation suggests possibilities for future entertainment and has the potential to influence the integration of technology and art. Over 5,000 viewers experienced Japanese culture through this new medium of animation generated by AI.

The video produced through this project significantly augmented the understanding of Japanese culture by leveraging technological innovation, thus boosting the Nikkei brand's recognition and highlighting its innovative prowess. It played a crucial role in reinforcing Nikkei's global presence, simultaneously amplifying cultural outreach and social impact.

Specifically, the audience was treated to an immersive experience of traditional performing arts presented through a contemporary medium. This project exemplified the successful fusion of Noh, recognized as the world's oldest performing art, with Nikkei's specially developed state-of-the-art animation-generating AI. Such an endeavor marked a notable achievement in both cultural evolution and social contribution. It showcased how the Nikkei has significantly contributed to enriching the brand experience, aligning technological advancements with cultural heritage to create a unique and memorable impact.