Loading…

Structural Bootstrapping-A Novel, Generative Mechanism for Faster and More Efficient Acquisition of Action-Knowledge

Humans, but also robots, learn to improve their behavior. Without existing knowledge, learning either needs to be explorative and, thus, slow or-to be more efficient-it needs to rely on supervision, which may not always be available. However, once some knowledge base exists an agent can make use of...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on autonomous mental development 2015-06, Vol.7 (2), p.140-154
Main Authors: Worgotter, Florentin, Geib, Chris, Tamosiunaite, Minija, Aksoy, Eren Erdal, Piater, Justus, Hanchen Xiong, Ude, Ales, Nemec, Bojan, Kraft, Dirk, Kruger, Norbert, Wachter, Mirko, Asfour, Tamim
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Humans, but also robots, learn to improve their behavior. Without existing knowledge, learning either needs to be explorative and, thus, slow or-to be more efficient-it needs to rely on supervision, which may not always be available. However, once some knowledge base exists an agent can make use of it to improve learning efficiency and speed. This happens for our children at the age of around three when they very quickly begin to assimilate new information by making guided guesses how this fits to their prior knowledge. This is a very efficient generative learning mechanism in the sense that the existing knowledge is generalized into as-yet unexplored, novel domains. So far generative learning has not been employed for robots and robot learning remains to be a slow and tedious process. The goal of the current study is to devise for the first time a general framework for a generative process that will improve learning and which can be applied at all different levels of the robot's cognitive architecture. To this end, we introduce the concept of structural bootstrapping-borrowed and modified from child language acquisition-to define a probabilistic process that uses existing knowledge together with new observations to supplement our robot's data-base with missing information about planning-, object-, as well as, action-relevant entities. In a kitchen scenario, we use the example of making batter by pouring and mixing two components and show that the agent can efficiently acquire new knowledge about planning operators, objects as well as required motor pattern for stirring by structural bootstrapping. Some benchmarks are shown, too, that demonstrate how structural bootstrapping improves performance.
ISSN:1943-0604
2379-8920
1943-0612
2379-8939
DOI:10.1109/TAMD.2015.2427233