837 research outputs found
Fusion of Multimodal Information in Music Content Analysis
Get PDFMusic is often processed through its acoustic realization. This is restrictive in the sense that music is clearly a highly multimodal concept where various types of heterogeneous information can be associated to a given piece of music (a musical score, musicians' gestures, lyrics, user-generated metadata, etc.). This has recently led researchers to apprehend music through its various facets, giving rise to "multimodal music analysis" studies. This article gives a synthetic overview of methods that have been successfully employed in multimodal signal analysis. In particular, their use in music content processing is discussed in more details through five case studies that highlight different multimodal integration techniques. The case studies include an example of cross-modal correlation for music video analysis, an audiovisual drum transcription system, a description of the concept of informed source separation, a discussion of multimodal dance-scene analysis, and an example of user-interactive music analysis. In the light of these case studies, some perspectives of multimodality in music processing are finally suggested
Culture, Constructivism, and Media: Designing a Module on Carlos Slim
Get PDFMexican tycoon Carlos Slim Helú has been a fixture on Forbes’s list of billionaires since 1991, and for the past three years, he has topped the magazine’s list of the world’s richest men. Although he is exceptionally well-known in his native Mexico, the majority of American college students have never heard of Carlos Slim. This article presents a curricular module built around this charismatic and controversial figure. The module requires students to navigate Internet-supported news media in the target language (Spanish), and engages them in independent, small-group, and larger, teacher-led activities designed to foster critical and comparative skills in cultural competency and analysis through process-based, student-led inquiry. Pedagogically and methodologically, the author engages with the recommendations and conclusions of recent studies by ACTFL and MLA committees, as well as by other leading scholars, regarding both the use of technology in the classroom and the idea of “teaching culture.” The unit’s content significantly deepens and enriches students’ understanding of social, economic, and political issues in modern Mexico. The article carefully situates each stage and aspect of the curricular unit presented in relation to recent studies of constructivism in foreign language acquisition and on the hierarchy of Bloom’s taxonomy of learning objectives
A multimodal approach to initialisation for top-down speaker diarization of television shows
No full textBN-SLIM: A Bayesian network methodology for human reliability assessment based on Success Likelihood Index Method (SLIM)
No full textSuccess Likelihood Index Model (SLIM) is one of the widely-used deterministic techniques in human reliability assessment especially when data is insufficient. However, this method suffers from epistemic uncertainty as it extremely relies on expert judgment for determining the model parameters such as the rates and weights of the performance shaping factors (PSFs). Besides, given an operation consisting of several tasks, SLIM calculates the human error probability (HEP) by ignoring possible dependencies among the tasks.The present study is aimed at using Bayesian Network (BN) for improving the performance of SLIM in handling uncertainty arising from experts opinion and lack of data. To this end, SLIM is combined with BN to form the so-called BN-SLIM technique. We demonstrate how BN-SLIM can consider uncertainty associated with the rates of PSFs by using probability distributions. BN-SLIM is also able to provide a better estimation of human error probability by considering conditional dependencies resulting from common PSFs. The probability updating feature of BN-SLIM can be used to identify the PSFs contributing the most to human failure event. The outperformance of BN-SLIM over SLIM is demonstrated via an illustrative example.Safety and Security Scienc
Improving the performance of Success Likelihood Index Model (SLIM) using Bayesian Network
No full textSuccess Likelihood Index Model (SLIM) is one of the widely-used methods in human reliability assessment especially when data is insufficient. However, this method suffers from uncertainty as it heavily relies on expert judgment for determining the model parameters such as the rates and weights of the performance shaping factors. The present study is aimed at using Bayesian Network (BN) for improving the performance of SLIM in handling the uncertainty arising from experts opinion and lack of data. To this end, SLIM is combined with BN to form the so-called BN-SLIM technique. We applied both SLIM and BN-SLIM models to a hypothetical example and compared the results. It is shown that BN-SLIM is able to provide a better estimation of human error probability by considering dependencies. The probability updating feature of BN-SLIM in particular makes it possible to use new information to update the prior beliefs about the rates of the performance shaping factors, thus updating the resultant human error probabilities.Safety and Security Scienc
Audiovisual Analysis of Music Performances: Overview of an Emerging Field
No full textIn the physical sciences and engineering domains, music has traditionally been considered an acoustic phenomenon. From a perceptual viewpoint, music is naturally associated with hearing, i.e., the audio modality. Moreover, for a long time, the majority of music recordings were distributed through audio-only media, such as vinyl records, cassettes, compact discs, and mp3 files. As a consequence, existing automated music analysis approaches predominantly focus on audio signals that represent information from the acoustic rendering of music.Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.Multimedia Computin
Rushes video summarization using a collaborative approach
Get PDFThis paper describes the video summarization system developed by the partners of the K-Space European Network of Excellence for the TRECVID 2008 BBC rushes summarization evaluation. We propose an original method based on individual content segmentation and selection tools in a collaborative system. Our system is organized in several steps. First, we segment the video, secondly we identify relevant and redundant segments, and finally, we select a subset of segments to concatenate and build the final summary with video acceleration incorporated. We analyze the performance of our system through the TRECVID evaluation
- …
