1,720,966 research outputs found
A dynamic intelligence test framework for evaluating AI agents
Get PDFIn our recent work on the measurement of (collective) intelligence,we used a dynamic intelligence test to measure and comparethe performances of artificial agents. In this paper we give a detailed technical description of the testing framework, its design and implementation, showing how it can be used to quantitatively evaluate general purpose, single- and multi-agent artificial intelligence (AI). The source code and scripts to run experiments have been released as open-source, and instructions on how to administer the test to artificial agents have been outlined. This will allow evaluating new agent behaviours and also extending the scope of the test. Alternativetesting environments are discussed along with other considerationsrelevant to the robustness of multi-agent performance tests.The intuition is to encourage people in the AI community to quantitativelyevaluate new types of heuristics and algorithms individuallyand collectively using different communication and interaction protocols,and thus pave the way towards a rigorous, formal and unifiedtesting framework for general purpose agents
Historical account of computer models solving IQ test problems
Get PDFIn this short paper we summarise our work in [9] wherewe make a review of what has been done when intelligence test problems have been analysed through cognitive models or particular systems. This work has been motivated by an observed explosion of the number of papers on this topic in recent years. We have made a general account of all these works in terms of how they relate to each other and what their real achievements are. Not only do we aim at analysing the meaning, utility, and impact of these computer models, but also better understanding what these tests measure in machines, whether they are useful to evaluate AI systems, whether they are really challenging problems, and whether they are useful to understand (human) intelligence
Demonstrating and Testing the BML Compliance of BML Realizers
Get PDFvan Welbergen H, Xu Y, Thiebaux M, et al. Demonstrating and Testing the BML Compliance of BML Realizers. In: Vilhjálmsson HH, Kopp S, Marsella S, Thórisson KR, eds. Intelligent Virtual Agents. IVA 2011. Lecture Notes in Computer Science. Vol 6895. Berlin, Heidelberg: Springer Berlin Heidelberg; 2011: 269-281.BML realizers are complex software modules that implement a standardized interface –the BML specification language– to steer the behavior of a virtual human. We aim to promote and test the compliance of realizers that implement this interface. To this end we contribute a corpus of example BML scripts and a tool called RealizerTester that can be used to formally test and maintain adherence of realizers to the BML standard. The standardized interface of realizers allowed us to implement RealizerTester as an automatic testing framework that can test any realizer. RealizerTester can 1) help in maintaining the stability and extensibility that is crucial for realizers and 2) contribute to the formalization of the emerging BML standard, both by providing test scripts and a formal description of their constraints and by identifying and resolving execution inconsistencies between realizers. We illustrate the testing practices used in the development of two realizers and demonstrate how RealizerTester is integrated with these practices. The scripts in the example corpus were executed on both realizers. This resulted in a video corpus that demonstrates the semantic equivalences and differences in execution of BML scripts by the two realizers
Recommended from our members
Simulated Perceptual Grouping: An Application to Human-Computer Interaction
Get PDFThe perceptual principles that allow people to group visually similar objects into entities, or groups, have been called the Gestalt Laws of perception. Two well known principles of perceptual grouping are proximity and similarity: objects that lie close together are perceived to fall into groups; objects of similar shape, size or color are more likely to form groups than objects differing along these dimensions. While the primary function of these "laws" is to help us perceive the world, they also enter into our communications. People can build on assumptions about each other's perception of the world as a basis for simplifying discourse: for example, we invariably refer to collections of objects simply by gesturing in their direction and uttering "those." The current work describes an algorithm that simulates parts of the visual grouping mechanism at the object level. The system uses feature spaces and simple ranking methods to produce object groupings. Computational aspects of this system are described in detail and its uses for enhancing multi-modal interfaces are explained
On Applicability of Automated Planning for Incident Management
No full textIncident management aims to save human lives, mitigate the effect of accidents, prevent damages, to mention a few of their benefits. Efficient coordination of rescue team members, allocation of available resources, and appropriate responses to the realtime unfolding of events is critical for managing incidents successfully.
Coordination involves a series of decisions and event monitoring, usually made by human coordinators, for instance task definition, task assignment, risk assessment, etc. Each elementary decision can be described by a named action (e.g. boarding an ambulance, assigning a task). Taken as a whole, the team coordinating an incident
response can be seen as a decision-making system.
In this paper, we discuss how invaluable assistance can be brought to such a system using automated planning.
In consultation with experts we have derived a set of requirements from which we provide a formal specification of the domain. Following the specification, we have developed a prototype domain model and evaluated it empirically. Here we present the results of this evaluation, along with several challenges (e.g uncertainty) that
we have identifie
Going Beyond Counting First Authors in Author Co-citation Analysis
Get PDFThe present study examines one of the fundamental aspects of author co-citation analysis (ACA) - the way co-citation
counts are defined. Co-citation counting provides the data on which all subsequent statistical analyses and mappings
are based, and we compare ACA results based on two different types of co-citation counting - the traditional type that
only counts the first one among a cited work's authors on the one hand and a non-traditional type that takes into
account the first 5 authors of a cited work on the other hand. Results indicate that the picture produced through this non-traditional author co-citation counting contains more coherent author groups and is therefore considerably clearer. However, this picture represents fewer specialties in the research field being studied than that produced through the traditional first-author co-citation counting when the same number of top-ranked authors is selected and analyzed. Reasons for these effects are discussed
Variations on the Author
Get PDF“Variations on the Author” discusses two of Eduardo Coutinho’s recent films (Um Dia na Vida, from 2010, and Últimas Conversas, posthumously released in 2015) and their contribution to the general question of documentary authorship. The director’s filmography is characterized by a consistent yet self-effacing form of authorial self-inscription: Coutinho often features as an interviewer that rather than express opinions propels discourses; an interviewer that is good at listening. This mode of self-inscription characterizes him as an author who is not expressive but who is nonetheless markedly present on the screen. In Um Dia na Vida, however, Coutinho is completely absent form the image, while Últimas Conversas, on the contrary, includes a confessional prologue that moves the director from the margins to the center of his films. This article examines the ways in which these works stand out in the filmography of a director who offers new insights into the notion of cinematic authorship
Appropriate Similarity Measures for Author Cocitation Analysis
Get PDFWe provide a number of new insights into the methodological discussion about author cocitation analysis. We first argue that the use of the Pearson correlation for measuring the similarity between authors’ cocitation profiles is not very satisfactory. We then discuss what kind of similarity measures may be used as an alternative to the Pearson correlation. We consider three similarity measures in particular. One is the well-known cosine. The other two similarity measures have not been used before in the bibliometric literature. Finally, we show by means of an example that our findings have a high practical relevance.information science;Pearson correlation;cosine;similarity measure;author cocitation analysis
- …
