Hochschule Bonn-Rhein-Sieg
Publikationsserver der Hochschule Bonn-Rhein-Sieg - pub H-BRSNot a member yet
7939 research outputs found
Sort by
Masterprüfungsordnung 2021 in der Fassung der 1. Änderungsordnung für den Studiengang Corporate Social Responsibility (CSR) and Non Governmental Organisation (NGO) Management (MBA) am Campus Rheinbach der Hochschule Bonn-Rhein-Sieg vom 19.05.2022
torchtime
The aim of torchtime is to apply PyTorch to the time series domain. By supporting PyTorch, torchtime follows the same philosophy of providing strong GPU acceleration, having a focus on trainable features through the autograd system, and having consistent style (tensor names and dimension names). Therefore, it is primarily a machine learning library and not a general signal processing library. The benefits of PyTorch can be seen in torchtime through having all the computations be through PyTorch operations, which makes it easy to use and feel like a natural extension
Propiedades psicométricas de dos escalas de restauración psicológica: traducción, adaptación y validez de las versiones brasileñas
Multimodal Transformers for Biomedical Text and Knowledge Graph Data
Recent advances in Natural Language Processing have substantially improved contextualized representations of language. However, the inclusion of factual knowledge, particularly in the biomedical domain, remains challenging. Hence, many Language Models (LMs) are extended by Knowledge Graphs (KGs), but most approaches require entity linking (i.e., explicit alignment between text and KG entities). Inspired by single-stream multimodal Transformers operating on text, image and video data, this thesis proposes the Sophisticated Transformer trained on biomedical text and Knowledge Graphs (STonKGs). STonKGs incorporates a novel multimodal architecture based on a cross encoder that uses the attention mechanism on a concatenation of input sequences derived from text and KG triples, respectively. Over 13 million so-called text-triple pairs, coming from PubMed and assembled using the Integrated Network and Dynamical Reasoning Assembler (INDRA), were used in an unsupervised pre-training procedure to learn representations of biomedical knowledge in STonKGs. By comparing STonKGs to an NLP- and a KG-baseline (operating on either text or KG data) on a benchmark consisting of eight fine-tuning tasks, the proposed knowledge integration method applied in STonKGs was empirically validated. Specifically, on tasks with a comparatively small dataset size and a larger number of classes, STonKGs resulted in considerable performance gains, beating the F1-score of the best baseline by up to 0.083. Both the source code as well as the code used to implement STonKGs are made publicly available so that the proposed method of this thesis can be extended to many other biomedical applications