1,720,986 research outputs found

    Introduction: gaze, interaction and eye-tracking: A multidisciplinary endeavor

    No full text
    status: Publishe

    Gaze as a predictor for lexical and gestural alignment

    No full text
    status: Publishe

    Multimodal mockery in face-to-face interaction: on the negotiation of nonseriousness and stance

    No full text
    This dataset was analyzed as part of the dissertation entitled "Multimodal mockery in face-to-face interaction: on the negotiation of nonseriousness and stance". The dataset contains the extracted annotations of video corpora and gaze behavior measures for quantitative analysis, R script to reproduce the results and figures for the dissertation, and two example video clips to illustrate the corpora. The dissertation investigates the ubiquitous phenomenon of mockery as a case study of complex stancetaking. The starting point is the observation that stancetaking, the expression of our attitudes toward the world around us, is inherently multimodal. What is missing, however, is a multimodal and interactional analysis of more complex forms of stancetaking. Mockery presents an intriguing case to explore this, as it involves a layered constellation in which a stance on a serious layer is heightened, diminished, or inverted on a non-serious layer. Using three video corpora of spontaneous triadic interactions between friends, the dissertation examines the role of bodily-visual resources in negotiating stance and nonseriousness in sequences of mockery. 1556 cases of mockery were identified, which were analyzed in three empirical studies on initiating, managing, and elaborating the mockery. Taking a primarily qualitative and sequential approach, these studies show that bodily-visual resources contribute to the negotiation of mockery in interaction: They perform a range of functions, including stancetaking and alignment, managing the participation framework, and depicting and indexing personae. As a whole, this dissertation contributes to the growing body of work on multimodal stancetaking, and provides a basis for a systematic integration of multimodality in the study of humor in interaction

    Going Beyond Counting First Authors in Author Co-citation Analysis

    Get PDF
    The present study examines one of the fundamental aspects of author co-citation analysis (ACA) - the way co-citation counts are defined. Co-citation counting provides the data on which all subsequent statistical analyses and mappings are based, and we compare ACA results based on two different types of co-citation counting - the traditional type that only counts the first one among a cited work's authors on the one hand and a non-traditional type that takes into account the first 5 authors of a cited work on the other hand. Results indicate that the picture produced through this non-traditional author co-citation counting contains more coherent author groups and is therefore considerably clearer. However, this picture represents fewer specialties in the research field being studied than that produced through the traditional first-author co-citation counting when the same number of top-ranked authors is selected and analyzed. Reasons for these effects are discussed

    Beyond Foreigner Talk: multimodal repertoires in L1-L2 interaction

    No full text
    This dataset was analyzed as part of my PhD project 'Beyond Foreigner Talk: multimodal repertoires in L1-L2 interaction'. It contains video recordings of dyadic interactions between L1 and L2 speakers of Dutch and French in both a picture description (PD) and a free conversation (FC) task. On the basis of the videos, body part tracking data and gesture annotations were created, which were analyzed using the R scripts and data tables found in this dataset. In addition the data also contains the stimuli and results from a behavioral experiment on gesture in L2 comprehension in Dutch. The context and objectives of these datasets are described in detail in my dissertation, which can also be found here.This research project challenges the common belief that first language (L1) speakers simplify their language when communicating with second language (L2) users, which is captured in Charles Ferguson’s ‘Foreigner Talk’ hypothesis. The stereotype suggests that L1 speakers use more and larger gestures, along with simplified vocabulary, to accommodate L2 speakers. However, we aim to move beyond the idea of simplification, recognizing the dynamic nature of linguistic registers. In our view, the distinction between L1 and L2 competence reflects a difference in knowledge of particular repertoires, that is, individual and cultural solutions to deal with recurrent communicative tasks. In this respect, we sought to understand how L1 speakers adjust their use of linguistic and gestural resources when interacting with L2 partners. We tested two common stereotypes about L1-L2 interaction through video-recorded picture descriptions and conversations. First, we found no evidence that L1 speakers gesture more or bigger when addressing L2 speakers. Instead, the amount of gesture was influenced by the task at hand and the social dynamics of the interaction, such as the degree of mutual attraction between participants. Nevertheless, we did observe differences in how gestures were used. L1 speakers employed more gestures that established spatial distinctions, helping to structure the description or the conversation. This practice made gestural movement stand out, rather than gesture size or frequency, and contributed to the interaction’s coherence. We also found evidence for this claim in a further experiment, where adding more gestures to a complex description improved comprehension for L1 listeners, but not for L2 listeners. Furthermore, making gestures more depictive or larger did not enhance their relevance for either group. Second, our findings do not support the idea of lexical simplification in L1-L2 interaction. While previous research on ‘Foreigner Talk’ has suggested that L1 speakers repeat their own words more frequently when speaking to L2 users, we found that self-repetition according to the conversational partner’s behavior rather than whether they were using an L1 or L2. In fact, L1 speakers were less dependent on the lexical choices of their L2 partners as compared to L1 partners. We observed a lower amount of cross-speaker repetition which may be explained by an increased meta-awareness of the dialog itself, leading to reduced automaticity. In conclusion, our research indicates that the use of speech and gesture in L1-L2 interaction is primarily shaped by the sort of repertoires and interactional processes the particular task requires, and the language background of the addressee modulates the extent to which these routines are relied on
    corecore