Incremental Sparsification for Real-time Online Model Learning
Online model learning in real-time is required by many applications such as in robot tracking control. It poses a difficult problem, as fast and incremental online regression with large data sets is the essential component which cannot be achieved by straightforward usage of off-the-shelf machine learning methods (such as Gaussian process regression or support vector regression). In this paper, we propose a framework for online, incremental sparsification with a fixed budget designed for large scale real-time model learning. The proposed approach combines a sparsification method based on an independence measure with a large scale database. In combination with an incremental learning approach such as sequential support vector regression, we obtain a regression method which is applicable in real-time online learning. It exhibits competitive learning accuracy when compared with standard regression techniques. Implementation on a real robot emphasizes the applicability of the proposed approach in real-time online model learning for real world systems.
Author(s): | Nguyen-Tuong, D. and Peters, J. |
Book Title: | JMLR Workshop and Conference Proceedings Volume 9: AISTATS 2010 |
Journal: | Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (AISTATS 2010) |
Pages: | 557-564 |
Year: | 2010 |
Month: | May |
Day: | 0 |
Editors: | Teh, Y.W. , M. Titterington |
Publisher: | JMLR |
Bibtex Type: | Conference Paper (inproceedings) |
Address: | Cambridge, MA, USA |
Event Name: | Thirteenth International Conference on Artificial Intelligence and Statistics |
Event Place: | Chia Laguna Resort, Italy |
Digital: | 0 |
Electronic Archiving: | grant_archive |
Language: | en |
Organization: | Max-Planck-Gesellschaft |
School: | Biologische Kybernetik |
Links: |
BibTex
@inproceedings{6505, title = {Incremental Sparsification for Real-time Online Model Learning}, journal = {Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (AISTATS 2010)}, booktitle = {JMLR Workshop and Conference Proceedings Volume 9: AISTATS 2010}, abstract = {Online model learning in real-time is required by many applications such as in robot tracking control. It poses a difficult problem, as fast and incremental online regression with large data sets is the essential component which cannot be achieved by straightforward usage of off-the-shelf machine learning methods (such as Gaussian process regression or support vector regression). In this paper, we propose a framework for online, incremental sparsification with a fixed budget designed for large scale real-time model learning. The proposed approach combines a sparsification method based on an independence measure with a large scale database. In combination with an incremental learning approach such as sequential support vector regression, we obtain a regression method which is applicable in real-time online learning. It exhibits competitive learning accuracy when compared with standard regression techniques. Implementation on a real robot emphasizes the applicability of the proposed approach in real-time online model learning for real world systems.}, pages = {557-564}, editors = {Teh, Y.W. , M. Titterington}, publisher = {JMLR}, organization = {Max-Planck-Gesellschaft}, school = {Biologische Kybernetik}, address = {Cambridge, MA, USA}, month = may, year = {2010}, slug = {6505}, author = {Nguyen-Tuong, D. and Peters, J.}, month_numeric = {5} }