Using AI tools in the creative process is becoming commonplace. However, most of these tools are designed to mimic existing expressions and streamline processes. How can we use AI in music production and live performances to create genuinely new and unique experiences, rather than simply imitating and automating what already exists?
In response to this question, Nao Tokui started experimenting with live performances featuring real-time audio synthesis with AI models. With his team, he developed Neutone FX—a universal host for real-time AI audio processing models—and Neutone Morpho, the first commercial trainable AI real-time audio plugin. During performances, he gently guides the AI models to achieve his musical vision while embracing their unexpected behaviors.
This project's evolution offers a glimpse into the future of AI-human co-creation in music, where musicians and performers take on the role of AI-jockeys. His experiences also highlight the importance of “misusable” AI tools in artistic practices.

Nao Tokui

Nao Tokui is an artist/DJ and researcher based in Tokyo. CEO and founder of Qosmo and Neutone.
While pursuing his Ph.D. at The University of Tokyo, he produced music using AI, including his debut album and a collaboration with Nujabes, the late legendary Japanese hip-hop producer. His work was released by various labels in Japan and Europe. After completing his Ph.D. research, he founded Qosmo, AI Creativity and Music Lab, in 2009. Since then, he has been actively working at the intersection of AI technology and art. Nao and his team's works have been exhibited at renowned venues such as the New York MoMA and the Barbican Centre in London. Their performances have also been showcased at various music festivals, including MUTEK and Sonar. Additionally, he is leading the development of AI-based music instruments at his newly founded company, Neutone. In 2021, Nao received the Okawa Publishing Award for his Japanese book on art, creativity, and AI. The book was translated and published in English as "Surfing human creativity with AI — A user's guide" in 2023.