University of Warsaw
Biblioteka Cyfrowa KLF UW (Digital Library of the Formal Linguistics Department at the University of Warsaw)Not a member yet
403 research outputs found
Sort by
Scanned texts as corpora - a case study
A modification of the Poliqarp corpora search tool is described, which
is oriented towards searching scanned texts with dirty OCR (i.e. the
fully automatic Optical Character Recognition without any
proof-reading). This search tool, called Poliqarp for DjVu, operates since
December 2009 and is available at http://poliqarp.wbl.klf.uw.edu.pl/.
The two-level regular expressions, which can be used in the queries,
allow at least in principle to circumvent the OCR errors.
The crucial property of the search engine is to highlight the hits on
the original scans stored in the DjVu format. Although the feature is
not original, as it has been used for the first time for the Century
Dictionary (http://global-language.com/CENTURY/) and later for
Jamieson's Etymological Dictionary of the Scottish Language
(http://www.scotsdictionary.com/), it is substantially augmented by
allowing so called graphical concordances and providing a convenient
way to bookmark the hits.
Our system handles now several dictionaries. One of them is so
called Warsaw Dictionary, published in 8 volumes in 1900-1927,
comprising almost 8000 pages, in particular 7541 pages with entries.
It has been scanned and OCRed by the library of the University of
Warsaw (http://ebuw.uw.edu.pl/publication/254). Another one is the
monumental dictionary of 16th century Polish, which is still the work
in progress. Our system handles 33 already published volumes, three of
them are digitally born, the rest has been scanned by
Kujawsko-Pomorska Digital Library
(http://kpbc.umk.pl/publication/17781). The volumes comprise together
almost 20000 pages, in particular 18296 pages with entries. Our case
study will be focused on the very dictionary, because it allow us to
demonstrate the use of regular expressions in the queries to account
for the pecularities of the 16th century Polish spelling.
Although at first our system (called at first marasca) was just a modification of Poliqarp, we
contribute in return to the original project. Since March 2010
National Corpus of Polish uses our version of the WWW Poliqarp
client
Granular rough mereological logics with applications to dependencies in information and decision systems
Dygitalizacja i komputeryzacja słowników na przykładzie Słownika polszczyzny XVI wieku
Digitalization and computerization of dictionaries (exemplified by the dictionary of the 16th century Polish)
For simple digitalization the recommended format is DjVu, which is produced in particular by the free pdf2djvu program. It is demonstrated that the OCR programs used by Kujawsko-Pomorska Digital Library are not adequate for the text of the dictionary, which contains many 16th century quotations. It is also stressed that scanning printed editions of digitally-born publications makes no sense from a user point of view, because the quality of OCRed scans will be always lower that that of an electronic document.
More sophisticated digitalization, called computerization, is only briefly mentioned, as the topic is discussed in details in Krzysztof Szafran's book. The possibility of treating the dictionary as a corpus is illustrated by searching the 32th volume of the dictionary with Poliqarp corpus tool