Inforex — a Collaborative Systemfor Text Corpora Annotation and Analysis Goes Open

Proceedings of Recent Advances in Natural Language Processing, pages 711–719, Varna, Bulgaria, Sep 2–4, 2019. https://doi.org/10.26615/978-954-452-056-4_083 711 Inforex — a Collaborative System for Text Corpora Annotation and Analysis Goes Open Michał Marci´nczuk and Marcin Oleksy G4.19 Research Group Department of Computational Intelligence Faculty of Computer Science and Management Wrocław University of Science and Technology, Wrocław, Poland {michal.marcinczuk,marcin.oleksy}@pwr.edu.pl Abstract In the paper we present the latest changes introduce to Inforex — a web-based system for qualitative and collaborative text corpora annotation and analy- sis. One of the most important news is the release of source codes. Now the system is available on the GitHub repository (https://github.com/ CLARIN-PL/Inforex) as an open source project. The system can be easily setup and run in a Docker container what simplifies the installation process. The major improvements include: semi- automatic text annotation, multilingual text preprocessing using CLARIN-PL web services, morphological tagging of XML documents, improved editor for annota- tion attribute, batch annotation attribute editor, morphological disambiguation, extended word sense annotation. This paper contains a brief description of the mentioned improvements. We also present two use cases in which various Inforex features were used and tested in real-life projects. 1 Introduction Development and evaluation of tools for various natural language processing task (named entity recognition, sentiment analysis, cyberbully detec- tion and many other) require dedicated resources in a form of manually or semi-automatically an- notated corpora. Corpus-based studies in the do- main of Digital Humanities also require a support in the form of specialized tools and system. Both create a demand on development of tools and sys- tems qualitative text corpora management, anno- tation, analysis and visualization. Inforex is one of several web-based systems for text corpora annotation which is being devel- oped as an open source project. The other well- known systems include, but are not limited to, We- bAnno 3.0 (de Castilho et al., 2016), Brat (Stene- torp et al., 2012) and Anafora (Chen and Styler, 2013). Comparing to the other systems Inforex has some distinct features, including: support for untokenized and tokenized documents, support for both plain text and XML documents (XML tags are used to format the document layout) and in- tegration with CLARIN-PL web services (utilizes on-demand morphological tagging). In Section 2 we present the basic characteristic of the Inforex system. In Section the 3 we present the recents improvements and new features imple- mented in the system. In the Section 4 we present two projects in which the latest features were uti- lized. 2 Inforex Overview Inforex is a web-based system for text corpora management, annotation and analysis. Since 2018 it is available as an open source project on the GitHub repository and is a part of the Polish CLARIN infrastructure1 — it is integrated with the official repository for language resources in Polish CLARIN2. From the user perspective In- forex requires only a modern web browser to use the system. Inforex offers several features for collabora- tive work on a single corpus, including concur- rent access to data stored in …

Content truncated to 500 words