1,726,114 research outputs found

    Do multiple experimenters improve the reproducibility of animal studies?

    Get PDF
    The credibility of scientific research has been seriously questioned by the widely claimed “reproducibility crisis”. In light of this crisis, there is a growing awareness that the rigorous standardisation of experimental conditions may contribute to poor reproducibility of animal studies. Instead, systematic heterogenisation has been proposed as a tool to enhance reproducibility, but a real-life test across multiple independent laboratories is still pending. The aim of this study was therefore to test whether heterogenisation of experimental conditions by using multiple experimenters improves the reproducibility of research findings compared to standardised conditions with only one experimenter. To this end, we replicated the same animal experiment in 3 independent laboratories, each employing both a heterogenised and a standardised design. Whereas in the standardised design, all animals were tested by a single experimenter; in the heterogenised design, 3 different experimenters were involved in testing the animals. In contrast to our expectation, the inclusion of multiple experimenters in the heterogenised design did not improve the reproducibility of the results across the 3 laboratories. Interestingly, however, a variance component analysis indicated that the variation introduced by the different experimenters was not as high as the variation introduced by the laboratories, probably explaining why this heterogenisation strategy did not bring the anticipated success. Even more interestingly, for the majority of outcome measures, the remaining residual variation was identified as an important source of variance accounting for 41% (CI(95) [34%, 49%]) to 72% (CI(95) [58%, 88%]) of the observed total variance. Despite some uncertainty surrounding the estimated numbers, these findings argue for systematically including biological variation rather than eliminating it in animal studies and call for future research on effective improvement strategies

    A Theory of Experimenters

    No full text
    This paper proposes a decision-theoretic framework for experiment design. We model experimenters as ambiguity-averse decision-makers, who make trade-offs between subjective expected performance and robustness. This framework accounts for experimenters’ preference for randomization, and clarifies the circumstances in which randomization is optimal: when the available sample size is large enough or robustness is an important concern. We illustrate the practical value of such a framework by studying the issue of rerandomization. Rerandomization creates a trade-off between subjective performance and robustness. However, robustness loss grows very slowly with the number of times one randomizes. This argues for rerandomizing in most environments

    Cebus apella Tolerate Intermittent Unreliability in Human Experimenters

    No full text
    Abstract Monkeys form expectations for outcomes based on interactions with human experimenters. Capuchins, a cooperative New World monkey species, not only anticipate receiving rewards that the experimenter indicates, but also apparently anticipate rewards based on what the experimenter has given to their partners. However, this could be due to subjects responding to either outcomes or experimenters. Here we examine whether capuchins will continue to interact with human experimenters who are occasionally unreliable. We tested 10 monkeys with a series of familiar human experimenters using an exchange task. The experimenters had never before participated in exchange studies with these monkeys, hence the monkeys learned about their behavior during the course of testing. Occasionally experimenters were unreliable, failing to give a reward after the monkey returned the token. The monkeys did recognize these interactions as different, responding much more quickly in trials following those that were nonrewarded than in other situations with the same experimenter. However, subjects did not change their preference for experimenters when given the opportunity to choose between the unreliable exchanger and another exchanger, nor did subjects learn to prefer reliable experimenters from watching other monkeys' interactions. Instead, subjects returned the tokens to the same location from which they received it. These results indicate that capuchins may not be sensitive to isolated instances in which experimenters are unreliable, possibly because of a strong bias to returning the token to the location from which it was donated

    Cebus apella Tolerate Intermittent Unreliability in Human Experimenters

    No full text
    Abstract Monkeys form expectations for outcomes based on interactions with human experimenters. Capuchins, a cooperative New World monkey species, not only anticipate receiving rewards that the experimenter indicates, but also apparently anticipate rewards based on what the experimenter has given to their partners. However, this could be due to subjects responding to either outcomes or experimenters. Here we examine whether capuchins will continue to interact with human experimenters who are occasionally unreliable. We tested 10 monkeys with a series of familiar human experimenters using an exchange task. The experimenters had never before participated in exchange studies with these monkeys, hence the monkeys learned about their behavior during the course of testing. Occasionally experimenters were unreliable, failing to give a reward after the monkey returned the token. The monkeys did recognize these interactions as different, responding much more quickly in trials following those that were nonrewarded than in other situations with the same experimenter. However, subjects did not change their preference for experimenters when given the opportunity to choose between the unreliable exchanger and another exchanger, nor did subjects learn to prefer reliable experimenters from watching other monkeys' interactions. Instead, subjects returned the tokens to the same location from which they received it. These results indicate that capuchins may not be sensitive to isolated instances in which experimenters are unreliable, possibly because of a strong bias to returning the token to the location from which it was donated

    Cebus Apella Tolerate Intermittent Unreliability in Human Experimenters

    Get PDF
    Monkeys form expectations for outcomes based on interactions with human experimenters. Not only do they anticipate receiving rewards which the experimenter indicates, but capuchin monkeys, a cooperative new world monkey species, apparently anticipate rewards based on what the experimenter has given to their partner. However, this could be due to subjects responding to either outcomes or experimenters. Here we examine whether capuchin monkeys will continue to interact with human experimenters who are occasionally unreliable. We tested ten monkeys with a series of familiar human experimenters using an exchange task. The experimenters had never before participated in exchange studies with these monkeys, hence the monkeys learned about their behavior during the course of testing. Occasionally experimenters were unreliable, failing to give a reward after the monkey returned the token. We found that monkeys did recognize these interactions as different, responding much more quickly in trials following those which were non-rewarded than in other situations with the same experimenter. However, subjects did not change their preference for experimenters when given the opportunity to choose between the unreliable exchanger and another exchanger, nor did subjects learn to prefer reliable experimenters from watching other monkeys’ interactions. Instead, subjects returned the tokens to the same location from which they received it. These results indicate that capuchin monkeys may not be sensitive to isolated instances in which experimenters are unreliable, possibly because of a strong bias to returning the token to the location from which it was donated

    Comparison of focus assignments between experimenters.

    No full text
    <p>An example image shows matches (within 8 pixels) of two experimenters in green using the position of experimenter P1. Unmatched foci that were selected only by experimenter P1 are shown in yellow and unmatched foci selected only by experimenter P2 are indicated in blue. The Jaccard score for this comparison was 0.81. Only spots within the DAPI stained region were extracted for analysis. Arrows indicate examples where experimenters have clicked a short distance from a maximum.</p

    Field Dependence: Experimenters' Expectancy, Sex Difference or No Difference?

    No full text
    The possibility that sex differences found in previous research on field dependence may have been due partly to experimenters' expectancy was investigated. Three pairs of naive student-experimenters received different information about expected outcomes for males and females on the Rod and Frame Test and the Embedded Figures Test. There was no evidence of an experimenters' expectancy effect, but there was also no significant difference in the performance of men and women on these two tests of field dependence. </jats:p

    Going Beyond Counting First Authors in Author Co-citation Analysis

    Get PDF
    The present study examines one of the fundamental aspects of author co-citation analysis (ACA) - the way co-citation counts are defined. Co-citation counting provides the data on which all subsequent statistical analyses and mappings are based, and we compare ACA results based on two different types of co-citation counting - the traditional type that only counts the first one among a cited work's authors on the one hand and a non-traditional type that takes into account the first 5 authors of a cited work on the other hand. Results indicate that the picture produced through this non-traditional author co-citation counting contains more coherent author groups and is therefore considerably clearer. However, this picture represents fewer specialties in the research field being studied than that produced through the traditional first-author co-citation counting when the same number of top-ranked authors is selected and analyzed. Reasons for these effects are discussed

    Variations on the Author

    Get PDF
    “Variations on the Author” discusses two of Eduardo Coutinho’s recent films (Um Dia na Vida, from 2010, and Últimas Conversas, posthumously released in 2015) and their contribution to the general question of documentary authorship. The director’s filmography is characterized by a consistent yet self-effacing form of authorial self-inscription: Coutinho often features as an interviewer that rather than express opinions propels discourses; an interviewer that is good at listening. This mode of self-inscription characterizes him as an author who is not expressive but who is nonetheless markedly present on the screen. In Um Dia na Vida, however, Coutinho is completely absent form the image, while Últimas Conversas, on the contrary, includes a confessional prologue that moves the director from the margins to the center of his films. This article examines the ways in which these works stand out in the filmography of a director who offers new insights into the notion of cinematic authorship
    corecore