Coco FM, a popular audio content platform backed by Google and Nandan Nilekani’s Fundamentum partnership, is harnessing the power of creative AI to revolutionize the creation, creation and consumption of stories. This change is led. Kunj Singhvion VP of content FM nailswho said the aim That generative AI is part of their daily work and content creation.

“On the production AI side, we are working pretty much on every layer of the process involved,” explains Singhvi. Trying AI to do. Now, in different languages, we are at different levels of success, but in English, our entire process has gone into AI.”

Coco FM is leveraging AI not only for content creation but also for audio production. The company uses Eleven Labs, ChatGPT APIs, and other available offerings to generate Live Voices.

“Dramatic voice is a special and difficult challenge, and long voice is also a difficult challenge. These are two things that most platforms operating in this space have not been able to solve,” noted Singhvi.

In terms of long-form content passed to Generative AI, Kuku FM also handles thumbnail generation, visual asset creation, and detail generation, and Singhvi said the team has custom GPTs for each process. are

Paying artists

AI is playing an important role in ensuring high quality production in different languages ​​and formats. “In languages ​​like Hindi and Tamil, the quality is decent, but for other languages ​​like Telugu, Kannada, Malayalam, Bangla and Marathi, the output quality is still poor,” Singhvi said.

However, the quality improves every week. “We have also produced some episodes in languages ​​where we are not happy with the quality to keep experimenting and improving,” added Singhvi.

Apart from content creation, AI is helping Kuku FM to comprehensively generate and analyze metadata. “We’ve used AI to create over 500 types of metadata on each of our content. The AI ​​itself identifies these attributes, and at an aggregate level, we can understand why some content performs better than others. What the demonstration does,” he said.

One of the most transformative aspects of Kuku FM’s use of AI is its impact on creators. The platform is in the process of empowering 5,000 creators to become full-stack creative producers.

“As creative AI tools improve, everyone is going to be a full-stack creator. They can make choices on visuals, voice, language and copy using AI as a co-pilot,” Singhvi said. “We’re training people to be creative producers who can own their content from start to finish.”

When asked about the competitive landscape and future plans for companies like Amazon’s Audible or PocketFM, Singhvi emphasized that AI should not be seen as a moat but as a platform. “Every company our size, not just our immediate competition, will use AI as a great enabler. AI will be commoditized; everyone will have access to the tools. What will remain important is You have a talent pool — storytellers,” he explained.

Everyone is a storyteller with AI.

In a unique experiment combining creative AI tools, former co-founder of OpenAI Andrej Karpati used the front page of the Wall Street Journal to create a music video on August 1st.2024.

Carpathi transcribed the entire front page of the newspaper into Claude, creating multiple scenes and providing visual explanations for each. These specifications were then fed back. Ideograms AI, an image creation tool, to create relevant visuals. The resulting images were then uploaded to RunwayML’s Gen 3 Alpha to create a 10-second video segment.

Singhvi also discussed the potential for edge applications of AI, such as producing audiobooks with one’s voice. “These are nice bells and whistles but not scalable applications of AI. However, they can dial in engagement as fresh experiences,” he said.

Coco FM is also working in new formats like video and comics, which are completely powered by AI. He said that the team is not going to shoot or design the characters in the studios. “Our in-house team works with AI to create unique content for videos, tunes and comics,” he revealed.

Singhvi believes Coco FM Blockbuster is turning storytelling into a science, making it more accessible and understandable. “The vision and structure of a story now looks like the structure of a product flow, thanks to AI,” Singhvi remarked.

“It democratizes storytelling, and makes every individual a potential storyteller.” As Singhvi aptly put it, “The only job left is that of a creative producer, to find new ways to engage the audience, because AI will always be biased towards the past.”