Min-Max Differential Dynamic Programming: Continuous and Discrete Time Formulations

In this work, the first min-max Game-Theoretic Differential Dynamic Programming (GT-DDP) algorithm in continuous time is derived. A set of backward differential equations for the value function is provided, along with its first- and second-order derivatives without assuming proximity of the initial...

Full description

Saved in:
Bibliographic Details
Published in:Journal of guidance, control, and dynamics control, and dynamics, 2018-12, Vol.41 (12), p.2568-2580
Main Authors: Sun, Wei, Pan, Yunpeng, Lim, Jaein, Theodorou, Evangelos A, Tsiotras, Panagiotis
Format: Article
Language:English
Subjects:
Algorithms
Control theory
Differential equations
Dynamic programming
Economic models
Feedforward control
Formulations
Game theory
Mathematical analysis
Mathematical models
Optimal control
Optimization
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this work, the first min-max Game-Theoretic Differential Dynamic Programming (GT-DDP) algorithm in continuous time is derived. A set of backward differential equations for the value function is provided, along with its first- and second-order derivatives without assuming proximity of the initial nominal controls to the optimal controls. The corresponding update laws for both the minimizing and maximizing controls are also derived. For comparison, the derivation of the GT-DDP algorithm in discrete time is presented in order to better elucidate the differences between the continuous and discrete time formulations. The effect of the game-theoretic formulation in the feed-forward and feedback parts of the optimal control policies is analyzed, and the discrete and continuous time GT-DDP algorithms are compared through numerical examples. Experimental results using a quadrotor demonstrate the superiority of GT-DDP in handling model uncertainties and external disturbances over the standard DDP algorithm.
ISSN:0731-5090
1533-3884
DOI:10.2514/1.G003516