Publication

Reward-weighted GMM and its application to action-selection in robotized shoe dressing

Conference Article

Conference

Iberian Robotics Conference (ROBOT)

Edition

3rd

Pages

141-152

Doc link

https://doi.org/10.1007/978-3-319-70836-2_12

File

Download the digital copy of the doc pdf document

Abstract

In the context of assistive robotics, robots need to make multiple decisions. We explore the problem where a robot has multiple choices to perform a task and must select the action that maximizes success probability among a repertoire of pre-trained actions. We investigate the case in which sensory data is only available before making the decision, but not while the action is being performed. In this paper we propose to use a Gaussian Mixture Model (GMM) as decision-making system. Our adaptation permits the initialization of the model using only one sample per component. We also propose an algorithm to use the result of each execution to update the model, thus adapting the robot behavior to the user and evaluating the effectiveness of each pre-trained action. The proposed algorithm is applied to a robotic shoe-dressing task. Simulated and real experiments show the validity of our approach.

Categories

artificial intelligence, learning (artificial intelligence), robots.

Scientific reference

A. Colomé, S. Foix, G. Alenyà and C. Torras. Reward-weighted GMM and its application to action-selection in robotized shoe dressing, 3rd Iberian Robotics Conference, 2017, Seville, in Robot 2017: Third Iberian Robotics Conference, Vol 694 of Advances in Intelligent Systems and Computing, pp. 141-152, Springer.