1,721,027 research outputs found
Meaningful Consent Study 2 Dataset
No full textData supporting:
Baarslag, Tim et al. (2017) An Automated Negotiation Agent for Permission Management. In, AAMAS 2017: 16th International Conference on Autonomous Agents and Multiagent Systems.
Additional Scenario file added 02/08/2017</span
Designing an automated negotiator: learning what to bid and when to stop
No full textIn this paper, the ongoing research of the author on designing an automated negotiator is described. One of the key challenges of designing a successful negotiation agent is that usually only limited information is available about the other party. Therefore, we need to combine various learning techniques to decide what offers to make, and when to accept. Our goal is to investigate techniques for developing a versatile automated negotiator that can effectively conduct negotiations in an incomplete information setting
Accepting optimally in automated negotiation with incomplete information
No full textWhen a negotiating agent is presented with an offer by its opponent, it is faced with a decision: it can accept the offer that is currently on the table, or it can reject it and continue the negotiation. Both options involve an inherent risk: continuing the negotiation carries the risk of forgoing a possibly optimal offer, whereas accepting runs the risk of missing out on an even better future offer. We approach the decision of whether to accept as a sequential decision problem, by modeling the bids received as a stochastic process. We argue that this is a natural choice in the context of a negotiation with incomplete information, where the future behavior of the opponent is uncertain. We determine the optimal acceptance policies for particular opponent classes and we present an approach to estimate the expected range of offers when the type of opponent is unknown. We apply our method against a wide range of opponents, and compare its performance with acceptance mechanisms of state-of-the-art negotiation strategies. The experiments show that the proposed approach is able to find the optimal time to accept, and improves upon widely used existing acceptance mechanism
Exploring the strategy space of negotiating agents: a framework for bidding, learning and accepting in automated negotiation
No full textThis book reports on an outstanding thesis that has significantly advanced the state-of-the-art in the area of automated negotiation. It gives new practical and theoretical insights into the design and evaluation of automated negotiators. It describes an innovative negotiating agent framework that enables systematic exploration of the space of possible negotiation strategies by recombining different agent components. Using this framework, new and effective ways are formulated for an agent to learn, bid, and accept during a negotiation. The findings have been evaluated in four annual instantiations of the International Automated Negotiating Agents Competition (ANAC), the results of which are also outlined here. The book also describes several methodologies for evaluating and comparing negotiation strategies and components, with a special emphasis on performance and accuracy measures
What to bid and when to stop
No full textNegotiation is an important activity in human society, and is studied by various disciplines, ranging from economics and game theory, to electronic commerce, social psychology, and artificial intelligence. Traditionally, negotiation is a necessary, but also time-consuming and expensive activity. Therefore, in the last decades there has been a large interest in the automation of negotiation, for example in the setting of e-commerce. This interest is fueled by the promise of automated agents eventually being able to negotiate on behalf of human negotiators.Every year, automated negotiation agents are improving in various ways, and there is now a large body of negotiation strategies available, all with their unique strengths and weaknesses. For example, some agents are able to predict the opponent's preferences very well, while others focus more on having a sophisticated bidding strategy. The problem however, is that there is little incremental improvement in agent design, as the agents are tested in varying negotiation settings, using a diverse set of performance measures. This makes it very difficult to meaningfully compare the agents, let alone their underlying techniques. As a result, we lack a reliable way to pinpoint the most effective components in a negotiating agent.There are two major advantages of distinguishing between the different components of a negotiating agent's strategy: first, it allows the study of the behavior and performance of the components in isolation. For example, it becomes possible to compare the preference learning component of all agents, and to identify the best among them. Second, we can proceed to mix and match different components to create new negotiation strategies., e.g.: replacing the preference learning technique of an agent and then examining whether this makes a difference. Such a procedure enables us to combine the individual components to systematically explore the space of possible negotiation strategies.To develop a compositional approach to evaluate and combine the components, we identify structure in most agent designs by introducing the BOA architecture, in which we can develop and integrate the different components of a negotiating agent. We identify three main components of a general negotiation strategy; namely a bidding strategy (B), possibly an opponent model (O), and an acceptance strategy (A). The bidding strategy considers what concessions it deems appropriate given its own preferences, and takes the opponent into account by using an opponent model. The acceptance strategy decides whether offers proposed by the opponent should be accepted.The BOA architecture is integrated into a generic negotiation environment called Genius, which is a software environment for designing and evaluating negotiation strategies. To explore the negotiation strategy space of the negotiation research community, we amend the Genius repository with various existing agents and scenarios from literature. Additionally, we organize a yearly international negotiation competition (ANAC) to harvest even more strategies and scenarios. ANAC also acts as an evaluation tool for negotiation strategies, and encourages the design of negotiation strategies and scenarios.We re-implement agents from literature and ANAC and decouple them to fit into the BOA architecture without introducing any changes in their behavior. For each of the three components, we manage to find and analyze the best ones for specific cases, as described below. We show that the BOA framework leads to significant improvements in agent design by wining ANAC 2013, which had 19 participating teams from 8 international institutions, with an agent that is designed using the BOA framework and is informed by a preliminary analysis of the different components.In every negotiation, one of the negotiating parties must accept an offer to reach an agreement. Therefore, it is important that a negotiator employs a proficient mechanism to decide under which conditions to accept. When contemplating whether to accept an offer, the agent is faced with the acceptance dilemma: accepting the offer may be suboptimal, as better offers may still be presented before time runs out. On the other hand, accepting too late may prevent an agreement from being reached, resulting in a break off with no gain for either party. We classify and compare state-of-the-art generic acceptance conditions. We propose new acceptance strategies and we demonstrate that they outperform the other conditions. We also provide insight into why some conditions work better than others and investigate correlations between the properties of the negotiation scenario and the efficacy of acceptance conditions.Later, we adopt a more principled approach by applying optimal stopping theory to calculate the optimal decision on the acceptance of an offer. We approach the decision of whether to accept as a sequential decision problem, by modeling the bids received as a stochastic process. We determine the optimal acceptance policies for particular opponent classes and we present an approach to estimate the expected range of offers when the type of opponent is unknown. We show that the proposed approach is able to find the optimal time to accept, and improves upon all existing acceptance strategies.Another principal component of a negotiating agent's strategy is its ability to take the opponent's preferences into account. The quality of an opponent model can be measured in two different ways. One is to use the agent's performance as a benchmark for the model's quality. We evaluate and compare the performance of a selection of state-of-the-art opponent modeling techniques in negotiation. We provide an overview of the factors influencing the quality of a model and we analyze how the performance of opponent models depends on the negotiation setting. We identify a class of simple and surprisingly effective opponent modeling techniques that did not receive much previous attention in literature.The other way to measure the quality of an opponent model is to directly evaluate its accuracy by using similarity measures. We review all methods to measure the accuracy of an opponent model and we then analyze how changes in accuracy translate into performance differences. Moreover, we pinpoint the best predictors for good performance. This leads to new insights concerning how to construct an opponent model, and what we need to measure when optimizing performance.Finally, we take two different approaches to gain more insight into effective bidding strategies. We present a new classification method for negotiation strategies, based on their pattern of concession making against different kinds of opponents. We apply this technique to classify some well-known negotiating strategies, and we formulate guidelines on how agents should bid in order to be successful, which gives insight into the bidding strategy space of negotiating agents. Furthermore, we apply optimal stopping theory again, this time to find the concessions that maximize utility for the bidder against particular opponents. We show there is an interesting connection between optimal bidding and optimal acceptance strategies, in the sense that they are mirrored versions of each other.Lastly, after analyzing all components separately, we put the pieces back together again. We take all BOA components accumulated so far, including the best ones, and combine them all together to explore the space of negotiation strategies.We compute the contribution of each component to the overall negotiation result, and we study the interaction between components. We find that combining the best agent components indeed makes the strongest agents. This shows that the component-based view of the BOA architecture not only provides a useful basis for developing negotiating agents but also provides a useful analytical tool. By varying the BOA components we are able to demonstrate the contribution of each component to the negotiation result, and thus analyze the significance of each. The bidding strategy is by far the most important to consider, followed by the acceptance conditions and finally followed by the opponent model.Our results validate the analytical approach of the BOA framework to first optimize the individual components, and then to recombine them into a negotiating agent
The value of information in automated negotiation: a decision model for eliciting user preferences
No full textConsider an agent that can autonomously negotiate and coordinate with others in our stead, to reach outcomes and agreements in our interest. Such automated negotiation agents are already common practice in areas such as high frequency trading, and are now finding applications in domains closer to home, which involve not only mere financial optimizations but balanced tradeoffs between multiple issues, such as cost and convenience. As a simple example, a smart thermostat controlling a heat pump could provide demand response to the electricity grid if the inconvenience is offset by the grid relieve incentives. In such situations, the agent represents a user with individual and a priori unknown preferences, which are costly to elicit due to the user bother this incurs. Therefore, the agent needs to strike a balance between increasing the user model accuracy and the inconvenience caused by interacting with the user. To do so, we require a tractable metric for the value of information in an ensuing negotiation, which until now has not been available. In this paper, we propose a decision model that finds the point of diminishing returns for improving the model of user preferences with costly queries. We present a reasoning framework to derive this metric, and show a myopically optimal and tractable stopping criterion for querying the user before a fixed number of negotiation rounds. Our method provides an extensible basis for interactive negotiation agents to evaluate which questions are worth posing given the marginal utility expected to arise from more accurate beliefs
Optimal incremental preference elicitation during negotiation
No full textThe last two decades have seen a growing interest in the development of automated agents that are able to negotiate on the user's behalf. When representing a user in a negotiation, it is essential for the agent to understand the user's preferences, without exposing them to elicitation fatigue. To this end, we propose a new model in which a negotiating agent may incrementally elicit the user's preference during the negotiation. We introduce an optimal elicitation strategy that decides, at every stage of the negotiation, how much additional user information to extract at a certain cost. Finally, we demonstrate the effectiveness of our approach by combining our policy with well-known negotiation strategies and show that it significantly outperforms other elicitation strategies
Accepting Optimally in Automated Negotiation with Incomplete Information (abstract)
No full textIntelligent SystemsElectrical Engineering, Mathematics and Computer Scienc
A polynomial time optimal algorithm for robot-human search under uncertainty
No full textThis paper studies a search problem involving a robot that is searching for a certain item in an uncertain environment (e.g., searching minerals on Moon) that allows only limited interaction with humans. The uncertainty of the environment comes from the rewards of undiscovered items and the availability of costly human help. The goal of the robot is to maximize the reward of the items found while minimising the search costs. We show that this search problem is polynomially solvable with a novel integration of the human help, which has not been studied in the literature before. Furthermore, we empirically evaluate our solution with simulations and show that it significantly outperforms several benchmark approaches
Interactive scheduling of appliance usage in the home
No full textWe address the problem of recommending an appliance usage schedule to the homeowner which balances between maximising total savings and maintaining sufficient user convenience. An important challenge within this problem is how to elicit the user preferences with low intrusiveness, in order to identify new schedules with high cost savings, that still lies within the user’s comfort zone. To tackle this problem we propose iDR, an interactive system for generating personalised appliance usage scheduling recommendations that maximise savings and convenience with minimal intrusiveness. In particular, our system learns when to stop interacting with the user during the preference elicitation process, in order to keep the bother cost (e.g., the amount of time the user spends, or the cognitive cost of interacting) minimal. We demonstrate through extensive empirical evaluation on real–world data that our approach improves savings by up to 35%, while maintaining a significantly lower bother cost, compared to state-of the-art benchmarks
- …
