19,381 research outputs found
Multi-Agent Reinforcement Learning using Centralized Critics in Collaborative Environments
Agents trained through single-agent reinforcement learning methods such as self-play can provide a good level of performance in multi-agent settings and even in fully cooperative environments. However, most of the time, training multiple agents together using single-agent self-play yields poor results as each agent tries to learn how to perform their task while their teammates are also learning. Thus, training models to reach an optimal behaviour in such situations becomes a challenging, if not impossible issue to overcome. One possible solution to deal with this problem is to facilitate a centralized training process in which the policies of all agents are evaluated by a centralized critic that has access to the observations and actions of all the agents in the environment. By using this approach, the environment becomes stationary and the agents learn in a similar way to using a single-agent algorithm in settings where only one agent needs to be trained. In this paper, we test whether by using a multi-agent reinforcement learning algorithm with centralized critics, as opposed to single-agent ones, we would obtain an agent that generalizes better to new partners in a collaborative environment such as Overcooked, where coordination is critical for good performance. The results display a similar performance between the two algorithms when evaluated through self-play and slightly better or worse results when paired with the human model, representing a mediocre agent, depending on the map. Thus, the multi-agent, centralized critics algorithm used in this study did not train agents that generalize better to new partners. However, the training metrics clearly indicate that the centralized critics method makes the agents learn and converge twice as fast as its single-agent version.https://github.com/andrei-07/rp-overcooked-centralized-critics Link to GitHub repositoryCSE3000 Research ProjectComputer Science and Engineerin
Schoengastia (Schoengastia) andrei , Vercammen-Grandjean 1958
Schoengastia (Schoengastia) andrei (Radford, 1948a): AFR Schoengastia (Schoengastia) andrei, Vercammen-Grandjean 1958bPublished as part of Nielsen, David H., Robbins, Richard G. & Rueda, Leopoldo M., 2021, Annotated world checklist of the Trombiculidae and Leeuwenhoekiidae (1758 - 2021) (Acari: Trombiculoidea), with notes on nomenclature, taxonomy, and distribution, pp. 1-243 in Zootaxa 4967 (1) on page 82, DOI: 10.11646/zootaxa.4967.1.1, http://zenodo.org/record/474551
Andrei Tarkovsky:
The author studies the originality of the film language of Andrei Tarkovsky, one of the great filmmakers of the twentieth century. For this purpose he considers the symbolic, poetic, technical and mystical elements of Tarkovsky’s seven films. Beyond the standard critics, he builds an unitary language for the interpretation of a work reputedly tight.El autor estudia la originalidad del lenguaje cinematográfico de Andrei Tarkovsky, uno de los grandes directores de cine del siglo XX. Para este propósito considera los aspectos simbólicos, poéticos, técnicos y místicos de sus siete películas. Desecha el formato de ficha crítica y construye un lenguaje unitario para la interpretación de una obra reputada como hermética
Identification of the radial configurations extracted from the weakly meshed structures of electrical distribution systems
História e Documentário no Cinema de Andrei Tarkóvski
In the article, the author discuses the Cinematic history and documentary of Andrei Tarkóvski
Podalonia andrei
<i>Podalonia andrei</i> (F. MORAWITZ 1889) 2, 9 <p>C h i n a:1, Yunnan Lijiang, 11.-15.VI.1995, leg. Kucera.</p> <p>M o n g o l i a:2, Gobi, Gurvan Saykhan N.P., 40 km W Dalanzadgad. 2000m, 28.-30. VI.2005, leg. J. Halada; 2, 1, 50 km N Ulaanbaatar riv., E Mandal, 1180m, 8.-13.VIII.2007, leg. M. Halada; 1, Bayankhongor, 75 km S Bayankhongor, 1150m. 9. VII.2004, leg. J. Halada; 1, Bayankhongor, 130 km S Bayankhongor, 45°03’N 100°59’E, 1240m, 6. VII.2004, leg. J. Halada; 1, Chulunt Gol (riv.), 47°48’N 100°19’E, 1940m, 23. VII.2005, leg. J. Halada; 1, Arkhangay, 90 km NE Tsetserleg, 48°03’N 102°25.5’E, 1400m, 24. VII.2004, leg. Kadlecova; 1, Bayankhongor, 16 km NW Bayankhongor, 46°13’N 102°25.5’E, 2165m, 11. VII.2004, leg. J. Halada.</p>Published as part of <i>Dollfuss, H., 2010, The Ammophilini Wasps of the Genera Eremnophila MENKE, Eremochares GRIBODO, Hoplammophila de BEAUMONT, Parapsammophila TASCHENBERG and Podalonia FERNALD of the " Biologiezentrum Linz " - Collection in Linz, Austria, (Hymenoptera, Apoidea, Sphecidae), pp. 535-560 in Linzer biologische Beiträge 42 (1)</i> on page 542, DOI: <a href="http://zenodo.org/record/5332553">10.5281/zenodo.5332553</a>
Second harmonic generation at fatigue cracks by low-frequency Lamb waves: experimental and numerical studies
Abstract not availableYi Yang, Ching-Tai Ng, Andrei Kotousov, Hoon Sohn, Hyung Jin Li
A comprehensive assessment of the solutions of the distribution system minimum loss reconfiguration problem
Andrei Tarkovsky:: devolver a la naturaleza sus enigmas
The author studies the originality of the film language of Andrei Tarkovsky, one of the great filmmakers of the twentieth century. For this purpose he considers the symbolic, poetic, technical and mystical elements of Tarkovsky’s seven films. Beyond the standard critics, he builds an unitary language for the interpretation of a work reputedly tight.El autor estudia la originalidad del lenguaje cinematográfico de Andrei Tarkovsky, uno de los grandes directores de cine del siglo XX. Para este propósito considera los aspectos simbólicos, poéticos, técnicos y místicos de sus siete películas. Desecha el formato de ficha crítica y construye un lenguaje unitario para la interpretación de una obra reputada como hermética
- …
