A Practical Evaluation of an Integrated Translation Tool during a Large Scale Localisation Project

A Practical Evaluation of an Integrated Translation Tool during a Large Scale Localisation Project Reinhard SchKler Department of Computer Science, University College Dublin, Belfield, Dublin 4, Ireland reinhard@nova, ucd. ie Abstract This paper reports on the assessment of computer assisted translation tools for a large localisation com- pany and the practical evaluation of one such tool. Introduction Over the past two years, a number of integrated translation tools which include a translation edi- tor, an on-line terminology database and a transla- tion memory system became commercially available. Most of these tools were targeted at the software lo- calisation industry, where the ability to produce con- sistent translations of highly repetitive texts within tight deadlines determines valuable market shares in an increasingly competitive market. The level of sophistication these tools have reached is still quite embryonic. Potential users have, in most cases, no practical experience with the issues involved in the application of such tools. They seek advice from experts who they feel can evaluate the systems in question for them, but even the ex- perts have not yet agreed on a standard evaluation approach. This paper reports on the assessment of computer assisted translation tools for a large localisation com- pany and the practical evaluation of one such tool during a large scale localisation project which in- volved the translation of around 1 million words into 9 languages at several different locations. The localisation of software and software docu- mentation, for a variety of reasons, is an idea] ap- plication area for the new generation of electronic translation tools (Translators' Workbenches), which integrate a translation editor, an electronic dictio- nary look-up system and a translation memory fea- ture (cf. Ishida 1994): Text in software and the accompanying docu- mentation is highly repetitive (up to 30%). Translation often starts at a H-stage. When the translation has to be updated to the final pro- duction version, Translators' Workbenches can detect modifications made to the original source file and automatically insert text that has pre- viously been translated. New releases of the same product have to be localised at ever decreasing intervals (every 9 months approximately). In this paper, we report that even one of the most sophisticated tools currently available still contains a considerable number of undesirable features many of which cannot, realistically, be identified during an initial test period. We also note that there are major critical issues not connected to any particular tool which have up to now been overlooked by both developers and potential users. Project Background In 1992, we were approached by one of the major lo- calisation companies in Ireland to assist them with the assessment of two Translators' Workbenches. Our initial brief was to recommend one of the two translation tools for use in the company's operation. There are no standard evaluation procedures for potential buyers of translation memory systems and none of the evaluation methods proposed for ma- chine translation systems (cf. Machine Translation 1993) is suitable because they are either too costly (translation memory …

Content truncated to 500 words