plain X - AI Supported Multilingual Video Workflow Platform

plain X – AI Supported Multilingual Video Workflow Platform Carlos Amaral Priberam Lisbon, Portugal carlos@priberam.pt Peggy van der Kreeft Deutsche Welle Bonn, Germany peggy.van-der-kreeft@dw.com Abstract The plain X platform is a toolbox for multilingual adaptation, for video, audio, and text content. The software is a 4-in-1 tool, combining several steps in the adap- tation process, i.e., transcription, transla- tion, subtitling, and voice-over, all auto- matically generated, but with a high level of editorial control. Users can choose which translation engine is used (e.g., MS Azure, Google, DeepL) depending on best performance. As a result, plain X enables a smooth semi-automated pro- duction of subtitles or voice-over, much faster than with older, manual workflows. The software was developed out of EU research projects and has recently been rolled out for professional use. It brings Artificial Intelligence (AI) into the multi- lingual media production process, while keeping the human in the loop. 1 Introduction plain X has been built by and for the media industry, although its use can be extended to other sectors as well. A key driver is the growing amount of content which needs lan- guage adaptation., based on user or market needs, for enhanced accessibility or to com- ply with regulation. Feature development is based on the needs from Deutsche Welle (DW), a world broadcaster producing in over 30 languages. The plain X platform is the result of a partnership between DW as user partner and Priberam, a Lisbon-based natural language processing developer. © 2022 The authors. This article is licensed under a Creative Commons 3.0 licence, no derivative works, attribution, CCBY-ND. The platform simplifies the multilingual adapta- tion process to a large degree, enabling easy sub- titling in source and any target language require- ment. After a full year of preparation, we are currently rolling out the platform for daily use in Deutsche Welle. Some other organizations are trialing the tool. In the future the software will be available to others, based on a software-as-a- service subscription model. 2 Challenges The concept for plain X originated from the need to produce more with less, i.e., to use automation in the production process, so media producers can increase the volume of certain target lan- guages, distribute content in more languages, or use synthetic voice, allowing to reach more peo- ple in their own spoken tongue, including in spe- cific African or Asian regions. As DW produces content in so many languages, it is essential to cover as many languages as pos- sible, in the best possible quality, through a com- bination of engines from carefully selected pro- viders, for instance for transcription or transla- tion. In plain X users can freely switch between different translation engines. The software allows for the inclusion of additional engines in the future. As the tool was – and is – co-developed by user partner Deutsche Welle, direct access to user requirements and feedback is ensured. This re- vealed that integration with internal systems and customization is a must to reach the highest …

Content truncated to 500 words