Autonomous Motion Probabilistic Numerics Intelligent Control Systems Conference Paper 2016

Automatic LQR Tuning Based on Gaussian Process Global Optimization

Screen shot 2016 01 19 at 14.48.37

This paper proposes an automatic controller tuning framework based on linear optimal control combined with Bayesian optimization. With this framework, an initial set of controller gains is automatically improved according to a pre-defined performance objective evaluated from experimental data. The underlying Bayesian optimization algorithm is Entropy Search, which represents the latent objective as a Gaussian process and constructs an explicit belief over the location of the objective minimum. This is used to maximize the information gain from each experimental evaluation. Thus, this framework shall yield improved controllers with fewer evaluations compared to alternative approaches. A seven-degree- of-freedom robot arm balancing an inverted pole is used as the experimental demonstrator. Results of a two- and four- dimensional tuning problems highlight the method’s potential for automatic controller tuning on robotic platforms.

Author(s): Marco, Alonso and Hennig, Philipp and Bohg, Jeannette and Schaal, Stefan and Trimpe, Sebastian
Book Title: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA)
Pages: 270--277
Year: 2016
Month: May
Day: 16-21
Publisher: IEEE
Project(s):
Bibtex Type: Conference Paper (inproceedings)
DOI: 10.1109/ICRA.2016.7487144
Event Name: IEEE International Conference on Robotics and Automation
Event Place: Stockholm, Sweden
State: Published
Electronic Archiving: grant_archive
Links:

BibTex

@inproceedings{marco_ICRA_2016,
  title = {Automatic LQR Tuning Based on Gaussian Process Global Optimization},
  booktitle = {Proceedings of the IEEE International Conference on Robotics and Automation (ICRA)},
  abstract = {This paper proposes an automatic controller tuning framework based on linear optimal control combined with Bayesian optimization. With this framework, an initial set of controller gains is automatically improved according to a pre-defined performance objective evaluated from experimental data. The underlying Bayesian optimization algorithm is Entropy Search, which represents the latent objective as a Gaussian process and constructs an explicit belief over the location of the objective minimum. This is used to maximize the information gain from each experimental evaluation. Thus, this framework shall yield improved controllers with fewer evaluations compared to alternative approaches. A seven-degree- of-freedom robot arm balancing an inverted pole is used as the experimental demonstrator. Results of a two- and four- dimensional tuning problems highlight the method’s potential for automatic controller tuning on robotic platforms.},
  pages = {270--277},
  publisher = {IEEE},
  month = may,
  year = {2016},
  slug = {marco_icra_2016},
  author = {Marco, Alonso and Hennig, Philipp and Bohg, Jeannette and Schaal, Stefan and Trimpe, Sebastian},
  month_numeric = {5}
}