1,721,066 research outputs found
An Approach Based on Linked Open Data and Augmented Reality for Cultural Heritage Content-Based Information Retrieval
No full textNowadays, many technologies are changing our way of life, including those related to extended reality. One of the most interesting is Augmented Reality (AR). Today, even if this technology seems to be discovered yet, it is widely applied in several contexts, including the fruition and conservation of cultural heritage. Such spread is mainly offered by the new and more powerful mobile devices, allowing museums and art exhibitions to use AR to offer new experiences to visitors. In this paper, we present an augmented reality mobile system based on content-based image analysis techniques and Linked Open Data to improve the user knowledge about cultural heritage. We use different image analysis techniques, and we present several experimental results to show the performance of our system
A semantic approach for document classification using deep neural networks and multimedia knowledge graph
No full textThe amount of available multimedia data in different formats and from different sources increases everyday. From an information retrieval point of view, this high volume and heterogeneity of data involves several issues to be addressed related to information overload and lacks of well structured information. Even if modern information retrieval systems offer to the user manifold search options, it is still hard to find systems with optimal performances in the document seeking process starting from a given topic. In recent years, several frameworks have been proposed and developed to support this task based on different models and techniques. In this paper we propose a semantic approach to document classification using both textual and visual topic detection techniques based on deep neural networks and multimedia knowledge graph. A semantic multimedia knowledge base has been exploited and several experimental results show the effectiveness of our proposed approach
A Novel Approach to Populate Multimedia Knowledge Graph via Deep Learning and Semantic Analysis
No full textThe growth of data in volume and complexity needs automatic tools to manage and process information. Semantic Web Technologies are a silver bullet in this context due to their capacity to transform human-readable contents into machine-readable ones. Knowledge graphs and the related ontologies represent essential tools for managing very large knowledge bases. The population process of these knowledge structures is composed of expensive and time-consuming tasks, and we propose a novel approach to automate the population step. Our approach is based on novel techniques based on semantic analysis and deep learning using NoSQL technologies. Several results to show the effectiveness of our approach is also reported
Effects of Color Stain Normalization in Histopathology Image Retrieval using Deep Learning
No full textIn the last decade, many digital slides have been available in the pathological field thanks to the spreading of new technologies for computerized acquisition. Often hardware and software tools and devices are different among biomedical analysis centers; consequently, the digital slides do not have the same representation using different colorization, exposition, contrast, brightness, and other distortions. Many computer vision algorithms are sensitive to these differences, and, in specific tasks such as image retrieval, color stain normalization can be a helpful technique to mitigate this misunderstanding. In this paper, we explored the effects of color stain normalization in the patches based on Hematoxylin and Eosin (H&E) image retrieval to measure how and how much it impacts the accuracy of this task providing an exhaustive analysis employing a standard dataset
A combined approach for improving humanoid robots autonomous cognitive capabilities
No full textRecent technologies advancements promise to change our lives dramatically in the near future. A new different living society is progressively emerging, witnessed from the conception of novel digital ecosystems, where humans are expected to share their own spaces and habits with machines. Humanoid robots are more and more being developed and provided with enriched functionalities; however, they are still lacking in many ways. One important goal in this sense is to enrich their cognitive capabilities, to make them more “intelligent” in order to better support humans in both daily and special activities. The goal of this research is to set a step in bridging the gap between symbolic AI and connectionist approaches in the context of knowledge acquisition and conceptualization. Hence, we present a combined approach based on semantics and machine learning techniques for improving robots cognitive capabilities. This is part of a wider framework that covers several aspects of knowledge management, from representation and conceptualization, to acquisition, sharing and interaction with humans. Our focus in this work is in particular on the development and implementation of techniques for knowledge acquisition. Such techniques are discussed and validated through experiments, carried out on a real robotic platform, showing the effectiveness of our approach. The results obtained confirmed that the combination of the approaches gives superior performance with respect to when they are considered individually
A storytelling framework based on multimedia knowledge graph using linked open data and deep neural networks
No full textAutomatic storytelling is a broad challenge in research contexts such as Natural Language Processing and Contend Based Image Analysis. Despite the considerable achievements of machine learning techniques in these research fields, combining different approaches to fill the gap between an automatic generated story and human handwriting is hard. This work proposes a novel storytelling framework in the Cultural Heritage domain. We developed our framework based on a Multimedia Knowledge Graph (MKG), a crucial point of our work. Furthermore, we populated our Multimedia Knowledge Graph with a focused crawler that employs deep learning techniques to recognise a multimedia object from web resources. Furthermore, we used a combined approach of deep learning techniques and Linked Open Data (LOD) to retrieve information about images and depicted figures using Instance Segmentation. The system has a dynamic, user-friendly interface that guides the user during the storytelling process. Finally, we evaluated the system from a qualitative and quantitative point of view
A rule-based obfuscating focused crawler in the audio retrieval domain
No full textThe detection of violations of intellectual properties on multimedia files is a critical problem for the current infrastructure of the Internet, especially within very large document collections. To contrast such a problem, either proactive or reactive methods are used. The first category prevents the upload of infringing files themselves by comparing illegal files with a reference collection, while the second one responds to reports made by third parties or artificial intelligence systems in order to delete files deemed illegal. In this article we propose an approach that is both reactive and proactive at the same time, with the aim of preventing the deletion of legal uploads of files (or modifications of such files, such as remixes, parodies and other edits) due to the presence of illegal uploads on a platform. We developed a rule-based obfuscating focused crawler able to work with audio files in the Audio Information Retrieval (AIR) domain, but its use can be easily extended to other multimedia file types, such as videos or textual documents. Our proposed model automatically scans multimedia files uploaded to the public collection only when a user query is submitted to it. We will also show experimental results obtained during tests on a known musical collection. Several combinations of specific Neural Network-Similarity Scorer solutions are shown, and we will discuss the strength and efficiency of each combination
Multimedia ontology population through semantic analysis and hierarchical deep features extraction techniques
No full textThe rapid increase of available data in different complex contexts needs automatic tasks to manage and process contents. Semantic Web technologies represent the silver bullet in the digital Internet ecosystem to allow human and machine cooperation in achieving these goals. Specific technologies as ontologies are standard conceptual representations of this view. It aims to transform data into an interoperability format providing a common vocabulary for a given domain and defining, with different levels of formality, the meaning of informative objects and their possible relationships. In this work, we focus our attention on Ontology Population in the multimedia realm. An automatic and multi-modality framework for images ontology population is proposed and implemented. It allows the enrichment of a multimedia ontology with new informative content. Our multi-modality approach combines textual and visual information through natural language processing techniques, and convolutional neural network used the features extraction task. It is based on a hierarchical methodology using images descriptors and semantic ontology levels. The results evaluation shows the effectiveness of our proposed approach
Remifentanil provides hemodynamic stability and faster awakening time in transsphenoidal surgery
No full text- …
