Furtwangen University

Hochschulschriftenserver der Hochschule Furtwangen
Not a member yet
    9086 research outputs found

    Linguistic-Aware WordPiece Tokenization : Semantic Enrichment and OOV Mitigation

    No full text
    The LinPair approach introduces an approach to tokenization, tackling challenges in processing textual data for machine learning applications. This method refines the Word-Piece Tokenization technique by incorporating linguistic insights into token-tag pairs, thereby enriching Large Language Models (LLMs) with syntactic information. LinPair Tokenization is articulated through two distinct strategies: CompleteLinPair Tokenization, which is tailored for smaller datasets and enriches each token with part-of-speech (POS) information, and SmartLinPair Tokenization, designed to mitigate the impact of out-of-vocabulary (OOV) occurrences. The experimental analysis indicates that SmartLinPair Tokenization improves text classification tasks with BERT, showing an increase in F1-Score of up to 13.9% compared to a WordPiece baseline. The CompleteLinPair Tokenization method results in a decrease in classification performance. It is important to note that these findings are experiment specific and may not be generalizable to other contexts

    Blutgasanalyse

    No full text

    1,103

    full texts

    9,086

    metadata records
    Updated in last 30 days.
    Hochschulschriftenserver der Hochschule Furtwangen is based in Germany
    Access Repository Dashboard
    Do you manage Open Research Online? Become a CORE Member to access insider analytics, issue reports and manage access to outputs from your repository in the CORE Repository Dashboard! 👇