May Insights

Gemini Omni Model

Gemini Omni, a new framework for Google’s Gemini AI model that lets users create any output from any input. In its current state it can only generate video outputs, but it can do so using a combination of multiple input types:

Example of Gemini Omni creating a video output from a combination of inputs such as Video, Image, Audio, and Text prompts. Source: Google Deepmind.

We’ve been trying it for ourselves in the past few days, and will be sharing our thoughts on the model in our next AI Drop newsletter. Sign up here to stay up to date 

Claude Code in Unreal

Both Unreal and Unity have supported Claude Code integration for some time, but in May, the Unreal Tool company Geopogo announced a new Claude integration for Unreal Engine (which just recently teased its new version update).New updates include: 

• Level creation
• Blueprint generation
• C++ scripting assistance
• Asset placement
• Faster iteration and prototyping

Screenshot from Dave Alpert’s post announcing Geopogo’s Claude-to-Unreal connector. Source: LinkedIn

We did some initial testing and have been surprised by how easy the integration was when it came to building realistic worlds. Even the free demo offered on the Geopogo website allowed our creative team to create a sprawling metropolis in just 2 hours. We can see this technology thriving in open-world games and RPGs, where large playable areas are the priority. Games like Cyberpunk 2077, Spider-Man, or Watch_Dogs Legion come to mind. 

Where the technology falls short however, is whenever interaction needs to be embedded into the world and the plugin cannot create: 

• A blocked dam flooding the streets, 
• a citywide lockdown restricting map access, 
• or a forest fire spreading across lush greenery all change the way the player engages with the world

We still believe that the technology is a huge help for getting your ideas onto the screen, especially for smaller indie teams or solo developers.

AI UA outperforms Live-Action for eCommerce

We just completed a test for an eComm app: 100% AI high quality live action creative vs non AI live action creative and surprisingly the 100% AI ads significantly outperformed the non AI videos in both CTR and CVR. The AI took a little longer to produce (even though it was more cost effective) as we had to fine tune quite a lot of the prompts to prevent the AI missing silly details, like the children’s fingers! However, this opens up quite a lot of opportunity to scale and continue to test.

https://www.youtube.com/shorts/ak60L3q2Gtk