Large scale stochastic control: Algorithms, optimality and stability

dc.contributor.advisor Theodorou, Evangelos A.
dc.contributor.author Bakshi, Kaivalya Sanjeev
dc.contributor.committeeMember Grover, Piyush
dc.contributor.committeeMember Feron, Eric
dc.contributor.committeeMember Popescu, Ionel
dc.contributor.committeeMember Bogdan, Paul
dc.contributor.committeeMember Chen, Yongxin
dc.contributor.department Aerospace Engineering
dc.date.accessioned 2019-05-29T14:00:23Z
dc.date.available 2019-05-29T14:00:23Z
dc.date.created 2019-05
dc.date.issued 2018-11-29
dc.date.submitted May 2019
dc.date.updated 2019-05-29T14:00:23Z
dc.description.abstract Optimal control of large-scale multi-agent networked systems which describe social networks, macro-economies, traffic and robot swarms is a topic of interest in engineering, biophysics and economics. A central issue is constructing scalable control-theoretic frameworks when the number of agents is infinite. In this work, we exploit PDE representations of the optimality laws in order to provide a tractable approach to ensemble (open loop) and closed loop control of such systems. A centralized open loop optimal control problem of an ensemble of agents driven by jump noise is solved by a sampling algorithm based on the infinite dimensional minimum principle to solve it. The relationship between the infinite dimensional minimum principle and dynamic programming principles is established for this problem. Mean field game (MFG) models expressed as PDE systems are used to describe emergent phenomenon in decentralized feedback optimal control models of a continuum of interacting agents with stochastic dynamics. However, stability analysis of MFG models remains a challenging problem, since they exhibit non-unique solutions in the absence of a monotonicity assumption on the cost function. This thesis addresses the key issue of stability and control design in MFGs. Specifically, we present detailed results on a models for flocking and population evolution. An interesting connection between MFG models and the imaginary-time Schr¨odinger equation is used to obtain explicit stability constraints on the control design in the case of non-interacting agents. Compared to prior works on this topic which apply only to agents obeying very simple integrator dynamics, we treat nonlinear agent dynamics and also provide analytical design constraints.
dc.description.degree Ph.D.
dc.format.mimetype application/pdf
dc.identifier.uri http://hdl.handle.net/1853/61179
dc.language.iso en_US
dc.publisher Georgia Institute of Technology
dc.subject Nonlinear control
dc.subject Robust control
dc.subject Optimal control
dc.subject Mean field games
dc.subject Large scale systems
dc.title Large scale stochastic control: Algorithms, optimality and stability
dc.type Text
dc.type.genre Dissertation
dspace.entity.type Publication
local.contributor.advisor Theodorou, Evangelos A.
local.contributor.corporatename College of Engineering
local.contributor.corporatename Daniel Guggenheim School of Aerospace Engineering
relation.isAdvisorOfPublication aa760d2f-a820-43f1-b1ea-bcb6bfab8b13
relation.isOrgUnitOfPublication 7c022d60-21d5-497c-b552-95e489a06569
relation.isOrgUnitOfPublication a348b767-ea7e-4789-af1f-1f1d5925fb65
thesis.degree.level Doctoral
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
4.95 MB
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
3.88 KB
Plain Text