CLARIN-PL
Not a member yet
504 research outputs found
Sort by
plWordNet 4.0
No full textPLWordNet ver. 4.0 is a lexico-semantic network which reflects the lexical system of the Polish language with projection to the English language. Słowosieć, Princeton Wordnet, EnWordnet together the whole resource currently contains 506815 senses, 347564 synsets and over 1.5M relations and 361177 inter-lingual relations between lexical units. It is now the largest wordnet in the world and is still growing
enWordNet 1.0
No full textThe extension of Princeton WordNet built within the CLARIN-PL project. The attached file also contains the mapping to Open Multilingual Wordnet
Word embeddings for Polish (KGR10, Fasttext binary) kgr10_fasttext_bin_v1
No full textDistributional language model (binary) for Polish trained on KGR10 using Fasttext (vector dimension: 100)
CorpoGrabber
No full textCorpoGrabber: The Toolchain to Automatic Acquiring and Extraction of the Website Content
Jan Kocoń, Wroclaw University of Technology
CorpoGrabber is a pipeline of tools to get the most relevant content of the website, including all subsites (up to the user-defined depth). The proposed toolchain can be used to build a big Web corpora of text documents. It requires only the list of the root websites as the input. Tools composing CorpoGrabber are adapted to Polish, but most subtasks are language independent. The whole process can be run in parallel on a single machine and includes the following tasks: downloading of the HTML subpages of each input page URL [1], extracting of plain text from each subpage by removing boilerplate content (such as navigation links, headers, footers, advertisements from HTML pages) [2], deduplication of plain text [2], removing of bad quality documents utilizing Morphological Analysis Converter and Aggregator (MACA) [3], tagging of documents using Wrocław CRF Tagger (WCRFT) [4]. Last two steps are available only for Polish. The result is a corpora as a set of tagged documents for each website.
References
[1] https://www.httrack.com/html/faq.html
[2] J. Pomikalek. 2011. Removing Boilerplate and Duplicate Content from Web Corpora. Ph.D. Thesis. Masaryk University, Faculcy of Informatics. Brno.
[3] A. Radziszewski, T. Sniatowski. 2011. Maca – a configurable tool to integrate Polish morphological data. Proceedings of the Second International Workshop on Free/Open-Source Rule-Based Machine Translation. Barcelona, Spain.
[4] A. Radziszewski. 2013. A tiered CRF tagger for Polish. Intelligent Tools for Building a Scientific Information Platform: Advanced Architectures and Solutions. Springer Verlag
