Development of Self-Learning Vision-Based Mobile Robots for Acquiring Soccer Robots Behaviors

• Autores: Takayuki Nakamura
• Localización: Distributed Autonomous Robotic Systems 3 / coord. por Tim Lueth, Rudiger Dillmann, Paolo Dario, Heinz Wörn, 1998, ISBN 9783642721984, págs. 101-110
• Idioma: inglés
• Texto completo no disponible (Saber más ...)
• Resumen

  • An input generalization problem is one of the most important ones in applying reinforcement learning to real robot tasks. To cope with this problem, we propose a self-partitioning state space algorithm which can make non-uniform quantization of the multidimensional continuous state space. This method recursively splits its continuous state space into some coarse spaces called tentative states based on the relevance test for immediate reward r and discounted future reward Q which are collected during Q-learning process. When it finds out that a tentative state is relevant by the statistical test on a minimum description length (hereafter, MDL), it partitions this coarse space into finer spaces. To show that our algorithm has generalization capability, we apply our method to two tasks in which a soccer robot shoots a ball into a goal and prevent a ball from entering a goal. To show the validity of this method, the experimental results for computer simulation and a real robot are shown.