Hochschule Bonn-Rhein-Sieg

Publikationsserver der Hochschule Bonn-Rhein-Sieg - pub H-BRS
Not a member yet
    7939 research outputs found

    Satzung des Studierendenwerks Bonn der Hochschule Bonn-Rhein-Sieg vom 20.06.2022

    No full text

    torchtime

    No full text
    The aim of torchtime is to apply PyTorch to the time series domain. By supporting PyTorch, torchtime follows the same philosophy of providing strong GPU acceleration, having a focus on trainable features through the autograd system, and having consistent style (tensor names and dimension names). Therefore, it is primarily a machine learning library and not a general signal processing library. The benefits of PyTorch can be seen in torchtime through having all the computations be through PyTorch operations, which makes it easy to use and feel like a natural extension

    Pensionsrückstellungen nach IAS 19 nach der Niedrigzinsphase

    No full text

    Multimodal Transformers for Biomedical Text and Knowledge Graph Data

    No full text
    Recent advances in Natural Language Processing have substantially improved contextualized representations of language. However, the inclusion of factual knowledge, particularly in the biomedical domain, remains challenging. Hence, many Language Models (LMs) are extended by Knowledge Graphs (KGs), but most approaches require entity linking (i.e., explicit alignment between text and KG entities). Inspired by single-stream multimodal Transformers operating on text, image and video data, this thesis proposes the Sophisticated Transformer trained on biomedical text and Knowledge Graphs (STonKGs). STonKGs incorporates a novel multimodal architecture based on a cross encoder that uses the attention mechanism on a concatenation of input sequences derived from text and KG triples, respectively. Over 13 million so-called text-triple pairs, coming from PubMed and assembled using the Integrated Network and Dynamical Reasoning Assembler (INDRA), were used in an unsupervised pre-training procedure to learn representations of biomedical knowledge in STonKGs. By comparing STonKGs to an NLP- and a KG-baseline (operating on either text or KG data) on a benchmark consisting of eight fine-tuning tasks, the proposed knowledge integration method applied in STonKGs was empirically validated. Specifically, on tasks with a comparatively small dataset size and a larger number of classes, STonKGs resulted in considerable performance gains, beating the F1-score of the best baseline by up to 0.083. Both the source code as well as the code used to implement STonKGs are made publicly available so that the proposed method of this thesis can be extended to many other biomedical applications

    561

    full texts

    7,939

    metadata records
    Updated in last 30 days.
    Publikationsserver der Hochschule Bonn-Rhein-Sieg - pub H-BRS is based in Germany
    Access Repository Dashboard
    Do you manage Open Research Online? Become a CORE Member to access insider analytics, issue reports and manage access to outputs from your repository in the CORE Repository Dashboard! 👇