The Ellogon Web Annotation Tool: Annotating Moral Values and Arguments

Proceedings of the 13th Conference on Language Resources and Evaluation (LREC 2022), pages 3442–3450 Marseille, 20-25 June 2022 © European Language Resources Association (ELRA), licensed under CC-BY-NC-4.0 3442 The Ellogon Web Annotation Tool: Annotating Moral Values and Arguments Alexandros Fotios Ntogramatzis2,1, Anna Gradou1, Georgios Petasis1, and Marko Kokol3 1Institute of Informatics and Telecommunications, National Centre for Scientific Research (N.C.S.R.) “Demokritos” GR-153 10, P.O.BOX 60228, Aghia Paraskevi, Athens, Greece 2Department of Informatics and Telecommunications, National and Kapodistrian University of Athens 3Semantika Research, Semantika d.o.o., Zagrebška 40a, 2000 Maribor ntogram@di.uoa.gr, agradou@iit.demokritos.gr, petasis@iit.demokritos.gr marko.kokol@semantika.eu Abstract In this paper, we present the Ellogon Web Annotation Tool. It is a collaborative, web-based annotation tool built upon the Ellogon infrastructure offering an improved user experience and adaptability to various annotation scenarios by making good use of the latest design practices and web development frameworks. Being in development for many years, this paper describes its current architecture, along with the recent modifications that extend the existing functionalities and the new features that were added. The new version of the tool offers document analytics, annotation inspection and comparison features, a modern UI, and formatted text import (e.g. TEI XML documents, rendered with simple markup). We present two use cases that serve as two examples of different annotation scenarios to demonstrate the new functionalities. An appropriate (user-supplied, XML-based) annotation schema is used for each scenario. The first schema contains the relevant components for representing concepts, moral values, and ideas. The second includes all the necessary elements for annotating argumentative units in a document and their binary relations. Keywords: annotation tools, inter-annotation reliability, collaborative annotation, web-based annotation 1. Introduction The large amount of data that have been available over the last decades, has led to the development of special tools for extracting information that can be utilised in various tasks. Especially the need for the creation of high quality annotated corpora, has raised the neces- sity of developing user-friendly tools to facilitate the annotation process. There are two main annotation ap- proaches. In the semi-automatic approach, the anno- tator’s task is restricted to review and validate a pre- annotation process that was performed in an automatic way. On the contrary, in the manual method, the an- notator is responsible for the whole annotation process. Concerning the annotation tool design, there are three categories: desktop applications, browser-based solu- tions and distributed/collaborative applications. Each one has its own different limitations, as the first one is limited to the corpora found in a single local stor- age, while the second one has to deal with browser limitations. However, during the last years, a diverse ensemble of tools that explore alternative approaches that leverage the advantages of previous categories has arise. In this paper, we present a new version of the Ell- ogon Web-based annotation tool that was developed and used in the context of two research programs, VAST - Values Across Space and Time1 and Debate- 1https://www.vast-project.eu/ Lab2. The annotation tool covers the requirement of collaboration among partners without needing a special installation …

Content truncated to 500 words