Our project with Marsimoto was a unique blend of artistry and cutting-edge technology, resulting in stunning cover artwork and five innovative music videos for his latest singles.
The challenge was to merge creativity with advanced AI tools, pushing the boundaries of music video production. Künstliche Intelligenz (Artificial Intelligence) played a pivotal role, not only conceptually, but also technically.
For the “Jacky” and “K.I.” music video shorts, we extracted characters from GTA and transformed their appearances to resemble Marsimoto, Sido, and Marteria. These custom characters and assets were then embedded into GTA San Andreas, where we recorded and edited gameplay footage.
We harnessed the power of Midjourney and Runway’s Motion Brush tool to generate AI footage. Using ZoeDepth, we converted Midjourney’s 2D landscapes into 3D scenes, providing a dynamic backdrop for our characters’ walk cycles. Merging traditionally modelled, textured, and rigged 3D characters with AI-generated content created a seamless and immersive visual experience.
Further, we crafted eerie AI characters with Midjourney and added lip sync using D-ID, enhancing the surreal atmosphere of K.I.’s visuals. Style transfers using DomoAI added a final touch, transforming footage into anime, pixel, and comic styles, adding diversity and flair to the project.
The result is a captivating blend of music and technology, showcasing the endless possibilities of AI in creative industries.
