2,023 research outputs found
Multi-Agent Reinforcement Learning using Centralized Critics in Collaborative Environments
No full textAgents trained through single-agent reinforcement learning methods such as self-play can provide a good level of performance in multi-agent settings and even in fully cooperative environments. However, most of the time, training multiple agents together using single-agent self-play yields poor results as each agent tries to learn how to perform their task while their teammates are also learning. Thus, training models to reach an optimal behaviour in such situations becomes a challenging, if not impossible issue to overcome. One possible solution to deal with this problem is to facilitate a centralized training process in which the policies of all agents are evaluated by a centralized critic that has access to the observations and actions of all the agents in the environment. By using this approach, the environment becomes stationary and the agents learn in a similar way to using a single-agent algorithm in settings where only one agent needs to be trained. In this paper, we test whether by using a multi-agent reinforcement learning algorithm with centralized critics, as opposed to single-agent ones, we would obtain an agent that generalizes better to new partners in a collaborative environment such as Overcooked, where coordination is critical for good performance. The results display a similar performance between the two algorithms when evaluated through self-play and slightly better or worse results when paired with the human model, representing a mediocre agent, depending on the map. Thus, the multi-agent, centralized critics algorithm used in this study did not train agents that generalize better to new partners. However, the training metrics clearly indicate that the centralized critics method makes the agents learn and converge twice as fast as its single-agent version.https://github.com/andrei-07/rp-overcooked-centralized-critics Link to GitHub repositoryCSE3000 Research ProjectComputer Science and Engineerin
Andrei Tarkovsky:
No full textThe author studies the originality of the film language of Andrei Tarkovsky, one of the great filmmakers of the twentieth century. For this purpose he considers the symbolic, poetic, technical and mystical elements of Tarkovsky’s seven films. Beyond the standard critics, he builds an unitary language for the interpretation of a work reputedly tight.El autor estudia la originalidad del lenguaje cinematográfico de Andrei Tarkovsky, uno de los grandes directores de cine del siglo XX. Para este propósito considera los aspectos simbólicos, poéticos, técnicos y místicos de sus siete películas. Desecha el formato de ficha crítica y construye un lenguaje unitario para la interpretación de una obra reputada como hermética
História e Documentário no Cinema de Andrei Tarkóvski
No full textIn the article, the author discuses the Cinematic history and documentary of Andrei Tarkóvski
Andrei Tarkovsky:: devolver a la naturaleza sus enigmas
No full textThe author studies the originality of the film language of Andrei Tarkovsky, one of the great filmmakers of the twentieth century. For this purpose he considers the symbolic, poetic, technical and mystical elements of Tarkovsky’s seven films. Beyond the standard critics, he builds an unitary language for the interpretation of a work reputedly tight.El autor estudia la originalidad del lenguaje cinematográfico de Andrei Tarkovsky, uno de los grandes directores de cine del siglo XX. Para este propósito considera los aspectos simbólicos, poéticos, técnicos y místicos de sus siete películas. Desecha el formato de ficha crítica y construye un lenguaje unitario para la interpretación de una obra reputada como hermética
Fotografia ca apropiere și distanțare la Andrei Codrescu / Photography as distance and nearness to Andrei Codrescu
No full textThe present study is part of a PhD thesis titled “Space in Andrei Codrescu’s prose – between reality and imaginary”, analysing the religious space, the virtual space, the photo studio, the American space and the library, as reflected in the above mentioned writer’s prose. The chapter dedicated to the photo studio depicts the manner in which the professional environment of the writer’s parents and close relatives influence the perception of the Self and of the Other, passing from the hypostasis of photographed subject to that of photographer “withtheeyes”, starting from the postmodern statement: “I am a camera”. Our study presents the travel literature of the author, “Ay, Cuba!” and “Prof pe drum” (Road Scholar), the last one also an autobiographical volume, illustrated by photos as a completion of the text. We also discuss the transformation of Road Scholar into a documentary, well received by the critics. The second part of our study presents the text written by Andrei Codrescu for several photobooks, as Walker Evans’ “Cuba” and “Signs”, David Graham’s “Land of the free: What makes Americans different” and others. If, in thefirst part of the study, Andrei Codrescu needs the production of a photo camera to deepen the understanding of the words, we discover him in the second part as a verbalising agent helping the rounding and the guiding of a Weltanschauung for other viewers, the public of the images from the photo books
Andrei Sakharov: quarks and the structure of matter
No full textIn 1980, the Cold War was in full bloom. The Soviet father of the hydrogen bomb and Nobel Peace Laureate turned dissident physicist, Andrei Sakharov, had been exiled to Gorki by the Soviet authorities. Called senile and under heavy Soviet censorship, Sakharov had a hard time communicating with the outside world. Around this time, the author, Harry Lipkin, came into contact with Sakharov's scientific work. What followed was a remarkable adventure in which both scientists fought the Soviet censors, smuggling postcards and manuscripts into and out of the Soviet Union while trying to further scientific progress. Against a backdrop of politics, suppression, and genius, Andrei Sakharov, Quarks and the Structure of Matter details the search for the basic building blocks of matter, the path to understanding the forces that bind them together, and how scientific knowledge is learned, communicated and passed from one group of investigators to another.In 1980, the Cold War was in full bloom. The Soviet father of the hydrogen bomb and Nobel Peace Laureate turned dissident physicist, Andrei Sakharov, had been exiled to Gorki by the Soviet authorities. Called "senile" and under heavy Soviet censorship, Sakharov had a hard time communicating his latest scientific results to readers outside of Gorki. Some smuggled results reached the author, Harry Lipkin, who then realized that he and Sakharov were both pioneers in a new revolution on our understanding the structure of matter. The particle physics community had resisted their revelation that th
Andrei Tarkovsky’s Creative Phenomenon: the Artist’s Spiritual Mission
No full textСтатья поступила в редкацию 18.05.2016 г.В статье анализируются нравственно-философские аспекты кинематографа Андрея Тарковского как уникального явления мировой экранной культуры. Актуальность темы исследования связана с тем, что нравственно-эстетические проблемы творчества, поднятые Тарковским, остаются по-прежнему злободневными. Автор данной статьи, опираясь на анализ фильмов и теоретических работ А. Тарковского и других исследователей, пытается дать свою точку зрения на философию его творчества, концентрируя внимание на духовной миссии художника.The article analyzes ethical and philosophical aspects of Andrei Tarkovsky’s cinema as a unique phenomenon in global cinema culture. The relevance of this research topic is grounded in the still urgent ethical and aesthetical issues of creative work presented by Tarkovsky. The author of this article uses analysis of films and theoretical works by Andrei Tarkovsky and other researches to highlight an original intake of the philosophy of his works, focusing on the artist’s spiritual mission
The new comparative economics
No full textIn recent years, comparative economics experienced a revival, with a new focus on comparing capitalist economies. The theme of the new research is that institutions exert a profound influence on economic development. The authors argue that, to understand capitalist institutions, one needs to understand the basic tradeoff between the costs of disorder and those of dictatorship. They then apply this logic to study the structure of efficient institutions, the consequences of colonial transplantation, and the politics of institutional choice.Labor Policies,Decentralization,National Governance,Environmental Economics&Policies,Economic Theory&Research,National Governance,Environmental Economics&Policies,Economic Theory&Research,Governance Indicators,Banks&Banking Reform
Author response
No full textThe seemingly limitless diversity of proteins in nature arose from only a few thousand domain prototypes, but the origin of these themselves has remained unclear. We are pursuing the hypothesis that they arose by fusion and accretion from an ancestral set of peptides active as co-factors in RNA-dependent replication and catalysis. Should this be true, contemporary domains may still contain vestiges of such peptides, which could be reconstructed by a comparative approach in the same way in which ancient vocabularies have been reconstructed by the comparative study of modern languages. To test this, we compared domains representative of known folds and identified 40 fragments whose similarity is indicative of common descent, yet which occur in domains currently not thought to be homologous. These fragments are widespread in the most ancient folds and enriched for iron-sulfur- and nucleic acid-binding. We propose that they represent the observable remnants of a primordial RNA-peptide world
- …
