Dubverse.ai is an innovative platform that seeks to make video content more accessible to global audiences. Dubverse.ai has leveraged natural language processing, neural machine translation, and deep learning algorithms for its AI-powered automated dubbing and subtitling services. However, one challenge the company – and its users – often faced was with videos that had both music and dialogue present. The existing pipeline of standard automatic speech recognition (ASR) strips off both music and sound effects. This makes it difficult for any creator who wants to convert their video into multiple languages.

Now with AudioShake integrated directly into its platform, users can upload their content to Dubverse's automatic dubbing and subtitling service, which uses AudioShake's AI to separate the dialogue and music. Dubverse’s AI is then able to use the isolated dialogue to create a transcription and translation of the video in over 30 languages. Together, the fully automated solution improves the speed, cost, and accuracy of content localization for creators of any size or scale.