Game | EPFL Graph Search

A game is a structured form of play, usually undertaken for entertainment or fun, and sometimes used as an educational tool. Many games are also considered to be work (such as professional players of spectator sports or games) or art (such as jigsaw puzzles or games involving an artistic layout such as Mahjong, solitaire, or some video games). Games are sometimes played purely for enjoyment, sometimes for achievement or reward as well. They can be played alone, in teams, or online; by amateurs or by professionals. The players may have an audience of non-players, such as when people are entertained by watching a chess championship. On the other hand, players in a game may constitute their own audience as they take their turn to play. Often, part of the entertainment for children playing a game is deciding who is part of their audience and who is a player. A toy and a game are not the same. Toys generally allow for unrestricted play whereas games present rules for the player t

A simulation and behavioral study of decision and risk in blackjack

The purpose of this master project was to explore decision making process applied to a blackjack game and make the links with facets of impulsivity. The first part of this study goes through the mathematical of this game and presented the optimal policy, computed with reinforcement learning algorithm. We also computed with a Monte Carlo simulation, for each possible hand and for each possible decision, the 3 values

{Q}_{t}

{H}_{t}

and

{h}_{t}

, value function, risk, one-step-ahead risk proposed by d'Acremont & Bossaerts, 2008. The second part of the study present the result of the behavioural study. Forty-seven undergraduate students perform 200 blackjack hands and completed a self-report questionnaire evaluating impulsivity and risk attitude. Our analysis reveals links with lack of perseverance and decision time. Furthermore percentage of optimal decision along the game reveals learning with novice player. The result of this study can be used as a basis for future research in neuroimaging on the risk, to try to answer if is possible to distinguish brain area associated with one-step ahead versus total risk

2009

Multi-Agent Learning for Resource Allocation Problems

Ludek Cigler

We analyze resource allocation problems where N independent agents want to access C resources. Each resource can be only accessed by one agent at a time. In order to use the resources efficiently, the agents need to coordinate their access. We focus on decentralized coordination, i.e. coordination without central authority. We analyze coordination mechanisms for two different kind of agents: 1) cooperative, who follow the prescribed protocol entirely; and 2) non-cooperative, who attempt to maximize their own utility. We propose a novel approach to achieve a fair and efficient resource allocation when the agents are cooperative. The agents access resources in slots. At the beginning of each slot, they observe a global coordination signal – a random integer 1 ≤ k ≤ K . The agents then learn a different allocation for each value of the coordination signal. When modeled as a game, the canonical solution to the resource allocation problem is the correlated equilibrium. In a correlated equilibrium, a “smart” coordination device chooses the actions for the “stupid” agents, who then have no incentive to deviate from these recommendations. In contrast, in our solution the coordination signal is “stupid”, since it is not specific to the game. The agents are “smart”, because they learn their strategy independently for each signal value. We show that our learning algorithm converges to an efficient resource allocation in polynomial time. The resulting allocation becomes more fair as the number of signals K increases. A non-cooperative, self-interested agent can exploit our cooperative allocation scheme by accessing one resource all the time, until everyone else gives up. Therefore, for the non-cooperative agents, we consider an infinitely repeated resource allocation game with discounting. This game is symmetric and all the agents are identical, so we look for its symmetric subgame-perfect equilibria. (Bhaskar (2000)) proposed a solution for 2-agent, 1-resource allocation games: Agents start by symmetrically choosing their actions randomly, and as soon as they each choose different actions, they start to follow a convention that prescribes their actions from then on. We extend the concept of convention to the general resource allocation problems of N agents and C resources. We show that for any convention, there exists a symmetric subgame-perfect equilibrium that implements it. We present two conventions: bourgeois, where agents stick to the first allocation; and market, where agents pay for the use of resources, and observe a global coordination signal that allows them to alternate between different allocations. We define the price of anonymity of a convention as the ratio between the maximum social payoff of any (asymmetric) strategy profile and the expected social payoff of the convention. We show that the price of anonymity of the bourgeois convention is infinite. The market convention decreases this price by reducing the conflict between the agents.

EPFL2013

Multi-Agent Learning for Resource Allocation Problems

Ludek Cigler

EPFL2013

A simulation and behavioral study of decision and risk in blackjack

{Q}_{t}

{H}_{t}

and

{h}_{t}

2009