Marden, Jason R. and Young, H. Peyton and Arslan, Gürdal and Shamma, Jeff S. (2008) Payoff based dynamics for multi-player weakly acyclic games. In: 46th IEEE Conference on Decision and Control. IEEE Proceedings Conference on Decision and Control . IEEE , Piscataway, NJ, pp. 3422-3427. ISBN 978-1-4244-1497-0 http://resolver.caltech.edu/CaltechAUTHORS:20101001-102738980
- Published Version
See Usage Policy.
Use this Persistent URL to link to this item: http://resolver.caltech.edu/CaltechAUTHORS:20101001-102738980
We consider repeated multi-player games in which players repeatedly and simultaneously choose strategies from a finite set of available strategies according to some strategy adjustment process. We focus on the specific class of weakly acyclic games, which is particularly relevant for multi-agent cooperative control problems. A strategy adjustment process determines how players select their strategies at any stage as a function of the information gathered over previous stages. Of particular interest are “payoff based” processes, in which at any stage, players only know their own actions and (noise corrupted) payoffs from previous stages. In particular, players do not know the actions taken by other players and do not know the structural form of payoff functions. We introduce three different payoff based processes for increasingly general scenarios and prove that after a sufficiently large number of stages, player actions constitute a Nash equilibrium at any stage with arbitrarily high probability. We also show how to modify player utility functions through tolls and incentives in so-called congestion games, a special class of weakly acyclic games, to guarantee that a centralized objective can be realized as a Nash equilibrium. We illustrate the methods with a simulation of distributed routing over a network.
|Item Type:||Book Section|
|Additional Information:||© 2007 IEEE. Research supported by NSF grant #ECS-0501394, ARO grant #W911NF– 04–1–0316, and AFOSR grant #FA9550-05-1-0239. The journal version of this papers appears in .|
|Other Numbering System:|
|Usage Policy:||No commercial reproduction, distribution, display or performance rights in this work are provided.|
|Deposited By:||Tony Diaz|
|Deposited On:||01 Oct 2010 22:13|
|Last Modified:||26 Dec 2012 12:29|
Repository Staff Only: item control page