Mean Field Stochastic Control Systems

May 27, 2011, 1100 Webb

Peter Caines

Abstract

The central notion of Mean Field (MF) (or Nash Certainty Equivalence (NCE)) stochastic control theory is that for general classes of large population stochastic dynamic games there exist Nash equilibria for the individual agents when each applies certain competitive strategies. In this work each agent is modelled by an individually controlled stochastic system and the systems interact through their individual cost functions and possibly via weak dynamical interaction. The crucial feedback nature of the MF control laws is that the optimal individual competitive actions against the mass behaviour act so as to collectively reproduce that mass behaviour (a xed point property), and hence the equilibrium is stable in the Nash game theoretic sense. The Nash equilibria and associated feedback control laws are precomputable in the in nite population case via the NCE Equation schemes and yield approximate equilibria when applied in the nite population case.

Speaker's Bio

Peter Caines received the BA in mathematics from Oxford University in 1967 and the PhD in systems and control theory in 1970 from Imperial College,University of London, under the supervision of David Q. Mayne, FRS. After periods as a postdoctoral researcher and faculty member at UMIST, Stanford, UC Berkeley, Toronto and Harvard, he joined McGill University, Montreal, in 1980, where he is James McGill Professor and Macdonald Chair in the Department of Electrical and Computer Engineering. Peter Caines is a Fellow of the IEEE, SIAM and the Canadian Institute for Advanced Research, was elected to the Royal Society of Canada in 2003 and received the IEEE Control Systems Society Bode Lecture Prize in 2009; he is the author of Linear Stochastic Systems, John Wiley, 1988, and his research interests include stochastic, multi-agent and hybrid systems theory together with their links to physics, economics and biology.