1,720,982 research outputs found

    Multi-agent reinforcement learning: A mean-field perspective

    Full text link
    Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-03-28 without embargo termsThe student, Muhammad Aneeq Uz Zaman, accepted the attached license on 2024-07-10 at 22:30.The student, Muhammad Aneeq Uz Zaman, submitted this Dissertation for approval on 2024-07-10 at 22:38.This Dissertation was approved for publication on 2024-07-24 at 09:00.DSpace SAF Submission Ingestion Package generated from Vireo submission #21061 on 2025-03-28 at 14:24:40Recent advancements in Reinforcement Learning (RL) have enabled significant progress in solving complex decision-making problems across various domains such as robotics, autonomous driving, and strategy games. However, many real-world scenarios involve multiple agents cooperating and competing with each other to achieve common goals, necessitating the development of Multi-Agent RL (MARL) algorithms. MARL not only addresses the challenges posed by interactions among agents but also enables robust learning in dynamic environments. Mean-Field Games (MFGs) offer a promising framework to tackle scalability issues in RL for multiple decision-making agents by considering the limiting case where the number of agents approaches infinity. Originating from seminal works, MFGs have seen extensive research, extensions, and applications in diverse fields. The thesis focuses on extending RL techniques for purely competitive games (Chapters 2, 3 and 6), Cooperative-Competitive (CC) games (Chapter 4) and the robust N -agent cooperative control problem (Chapter 5). Within purely competitive games Chapter 2 deals with a consensus problem where the agents are split into multiple populations. Although the thesis primarily deals with the Linear Quadratic (LQ) framework (which has applications in finance and engineering), we dedicate Chapter 3 to a general large population Markov game where we relax the assumption of access to a population (mean-field) simulator prevalent in literature. Chapter 4 is regarding a CC game where the agents are divided into multiple teams where these is intra-team cooperation and inter-team competition. Chapter 5 pertains to a purely cooperative control problem where the agents’ dynamics and cost functions can be manipulated by an adversary. This chapter takes the min-max approach by characterizing optimal policies in the presence of the worst adversarial manipulation. Chapter 6 investigates the effects of entropy regularization on cost functions of competitive agents and how it results in exploratory noise in the control policies of the agents. In each of these chapters we start with a literature review highlighting existing approaches and gaps in research. Then we characterize the various equilibria corresponding to each of the problems, followed by RL algorithms to compute these equilibria (in a data driven manner) along with finite sample guarantees and numerical validations

    A review of the environmental impact on the music festival / Muhammad Aneeq Aqashah Zubir

    Full text link
    This research intends to analyse the environmental impact of music festivals by using The Good Vibe Music Festival in Malaysia as a reference to scale the results. The ultimate purpose of this research is to develop frameworks for identifying the potential approaches to better manage those events. It is a review from literature study with the purpose of outlining the parameters of music festivals, what the usual practises are for arranging them, and other elements related with the production of these types of festivals. The findings of this study will be helpful to event organisations, suppliers, and vendors that have a direct connection with these events. This includes individuals and groups that might be interested in adopting environmentally friendly practises, as well as researchers who are interested in continuing their studies on this subject. In this study, a type of secondary data approach method that focuses on literature survey was used, and the findings showed that due to the scale of these events, which evolved over the years, has created various complexities and challenges in managing the masses due to the economics of scale that they bring. These findings were derived from the findings of another study that used a different type of qualitative research that focuses on interviews. Everything from the disposal of waste to the organisation of logistics takes up more and more space each year, which raises questions about the practicabili ty of continuing these events in the future. There are also some recommendations for future research in order to develop further literature regarding the impact of mega-scale event management on the environment, particularly in connection to its practise in Malaysia

    Going Beyond Counting First Authors in Author Co-citation Analysis

    Full text link
    The present study examines one of the fundamental aspects of author co-citation analysis (ACA) - the way co-citation counts are defined. Co-citation counting provides the data on which all subsequent statistical analyses and mappings are based, and we compare ACA results based on two different types of co-citation counting - the traditional type that only counts the first one among a cited work's authors on the one hand and a non-traditional type that takes into account the first 5 authors of a cited work on the other hand. Results indicate that the picture produced through this non-traditional author co-citation counting contains more coherent author groups and is therefore considerably clearer. However, this picture represents fewer specialties in the research field being studied than that produced through the traditional first-author co-citation counting when the same number of top-ranked authors is selected and analyzed. Reasons for these effects are discussed

    Variations on the Author

    Full text link
    “Variations on the Author” discusses two of Eduardo Coutinho’s recent films (Um Dia na Vida, from 2010, and Últimas Conversas, posthumously released in 2015) and their contribution to the general question of documentary authorship. The director’s filmography is characterized by a consistent yet self-effacing form of authorial self-inscription: Coutinho often features as an interviewer that rather than express opinions propels discourses; an interviewer that is good at listening. This mode of self-inscription characterizes him as an author who is not expressive but who is nonetheless markedly present on the screen. In Um Dia na Vida, however, Coutinho is completely absent form the image, while Últimas Conversas, on the contrary, includes a confessional prologue that moves the director from the margins to the center of his films. This article examines the ways in which these works stand out in the filmography of a director who offers new insights into the notion of cinematic authorship

    Appropriate Similarity Measures for Author Cocitation Analysis

    Full text link
    We provide a number of new insights into the methodological discussion about author cocitation analysis. We first argue that the use of the Pearson correlation for measuring the similarity between authors’ cocitation profiles is not very satisfactory. We then discuss what kind of similarity measures may be used as an alternative to the Pearson correlation. We consider three similarity measures in particular. One is the well-known cosine. The other two similarity measures have not been used before in the bibliometric literature. Finally, we show by means of an example that our findings have a high practical relevance.information science;Pearson correlation;cosine;similarity measure;author cocitation analysis

    Dispelling the Myths Behind First-author Citation Counts

    Full text link
    We conducted a full-scale evaluative citation analysis study of scholars in the XML research field to explore just how different from each other author rankings resulting from different citation counting methods actually are, and to demonstrate the capability of emerging data and tools on the Web in supporting more realistic citation counting methods. Our results contest some common arguments for the continued use of first-author citation counts in the evaluation of scholars, such as high correlations between author rankings by first-author citation counts and other citation counting methods, and high costs of using more realistic citation counting methods that are not well-supported by the ISI databases. It is argued that increasingly available digital full text research papers make it possible for citation analysis studies to go beyond what the ISI databases have directly supported and to employ more sophisticated methods

    Author Index

    No full text
    Nao informado

    koamabayili/VECTRON-author-checklist: VECTRON author checklist

    No full text
    We have done our best to complete the author checklist relating to the use of animals in the hut study. Note that the objective for the hut study was to evaluate the IRS treatment applications for residual efficacy against Anopheles mosquitoes, including the local An. coluzzii mosquito population. Cows were only used to attract mosquitoes into the huts and no tests were carried out directly on the cows. The author checklist is intended for use with studies where experiments are carried out on animals, which is why we have had such difficulty in completing this for the hut study, as many of the questions do not relate to how the cows were used
    corecore