The Corpora Management System Based on Java and Oracle Technologies

The Corpora Management System Based on Java and Oracle Technologies Serge Yablonsky Petersburg Transport University, Computer Department, Moscow ay., 9, St.-Petersburg, 190031, Russia Russicon Company, Kazanskaya str., 56, ap.2, St.-Petersburg, 190000, Russia serge yablonsky@hotmail.com ; root@russicon.spb.su; http://www.russicon.ru Abstract The paper discusses the corpora manage- ment system (CMS) design that uses Java and Oracle9i DBMS to support strategic corpora analysis. We present the pilot web- based CMS to support linguists in their daily work. The system offers facilities to assist linguists and internet users as they search for relevant material, and then clas- sify and annotate this material. 1 Introduction There's a wide class of documental management solutions and products that fall under the rubric "corpora and text mining". They are similar to data mining solutions in that they deal with large vol- umes of data, but the difference between the two technology solutions is that while data mining ex- tracts, analyzes, and summarizes numerical, struc- tured data, text mining handles large volumes of unstructured, text-based data. Document systems with large-scale linguistic annotation are used by a wide range of research and commercial applica- tions. This paper presents a web-based text corpora de- velopment system (CMS) that focuses on the de- velopment of UML-specifications, architecture and actual implementations of DBMS tools to support strategic corpora analysis. We present the basic features of a prototype cor- pora management system under development in- tended to support linguists in their daily work. The system offers facilities to assist linguists and inter- net users as they search for relevant material, and then classify and annotate this material in a reposi- tory. The CMS is implemented using Java and commer- cial DBMS Oracle9i. 2 System Overview The Corpora management system combines Java, XML, XSL, HTML, and Oracle9i components (Yablonsky S.A., 2002). The system was by adapt- ing existing and new DBMS and Java tools to the necessities of the intended task for the Russian language (Yablonsky S.A., 2000). CMS consists of such main parts (see figure 1): Corpora — files in more then 150 different for- mats (doc, rtf, pdf, htm, xml, etc.); Annotated corpora — files in XML format us- ing XML Corpus Encoding Standard (XCES, http://www.xml-ces.org — Ide, N. & Brew, C., 2000, Ide, N., Romary L., 2001) and text for- mats; Oracle 9i DBMS Enterprise Sever (Release 2) with such main counterparts: o Grammatical dictionaries (inflec- tion paradigms of the given lan- guage) for the languages that are not supported by Oracle Text; o Ontologies / WordNet (Fellbaum C.) / Domain Thesauruses for given languages; o Word Index (index of all entry words or lemmas of Corpora); 179 Search Engine Concept Clustering (Ontology Thesaurus) Document Management System Graphical Display and Navigation DBMS Oracle 9iR2� (--------C-cirp -Cr—a (PC, Internet/intrar - Ontology database - Grammatical Dictionary� XML, HTML, Doc, PDF etc. - Word Index� (150 format types) Web-server (Apache 2.x + Tomcat 4.1.x) Annotated Corpora XML 41101rn et/I ntraneNP Browser Browser Browser Figure 1. CMS structure O Oracle Text. Web Server (for example, Apache 2.x …

Content truncated to 500 words