Buradasınız

Anasayfa » Content

Using Q-Learning and Fuzzy Q-Learning Algorithms for Mobile Robot Navigation in Unknown Environment

Journal Name:

  • International Journal of Science and Engineering Investigations

Publication Year:

  • 2012

Key Words:

Author Name
Abstract (2. Language): 
One of the standing challenging aspects in mobile robotics is the ability to navigate autonomously. It is a difficult task, which requiring a complete modeling of the environment. This paper presents an intelligent navigation method for an autonomous mobile robot which requires only a scalar signal like a feedback indicating the quality of the applied action. Instead of programming a robot, we will let it only learn its own strategy. The Q-learning algorithm of reinforcement learning is used for the mobile robot navigation by discretizing states and actions spaces. In order to improve the mobile robot performances, an optimization of fuzzy controllers will be discussed for the robot navigation; based on prior knowledge introduced by a fuzzy inference system so that the initial behavior is acceptable. The effectiveness of this optimization method is verified by simulation.
Bookmark/Search this post with
FULL TEXT (PDF): 
PDF icon arastirmax-using-q-learning-and-fuzzy-q-learning-algorithms-mobile-robot-navigation-unknown-environment.pdf
  • 2
36-41
  • English

REFERENCES

References: 

[1] Shuzhi Sam Ge, Frank L. Lewis, Autonomous Mobile Robots, Sensing,
Control, Decision, Making and Applications, CRC, Taylor and Francis
Group, 2006.
[2] Maaref H., and Barret C.,” Sensor Based Navigation of an Autonomous
Mobile Robot in an Indoor Environment”, Control Engineering Practice,
Vol. 8, pp. 757-768, 2000.
[3] L. M. Zamstein, A. A. Arroyo, E. M. Schwartz, S. Keen, B. C. Sutton,
and G. Gandhi , "Koolio : Path Planning using Reinforcement Learning
on a Real Robot Platform " FCRAR, 19th Florida Conference on Recent
Advances in Robotics, Miami, Florida, May 25-26, 2006.
[4] R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction.
The MIT Press, Cambridge, MA, 1998.
[5] S. T. Hagen and B. Krose, "Q-Learning for Systems with Continuous
State and Action Spaces," in Proc. BENELEARN, 10th Belgian-Dutch
Conference in Machine Learning, 2000.
[6] C. Touzet, L’Apprentissage par Renforcement, Paris:Masson, 1999.
[7] M. Boumehraz , K. Benmahammed, M. L Hadjili and V. Wertz, " Fuzzy
Inference Systems Optimization by Reinforcement Learning," Courrier
du Savoir , no. 01, pp. 09-15, 2001.
[8] P. Y. Glorennec, and L. Jouffe, "Fuzzy Q-learning," in Proc. 1997,
FUZZ-IEEE’97, 6
th
IEEE International Conference on Fuzzy Systems,
pp. 659-662, 1997.
[9] C. Ye, N. H.C. Yung and D. Wang, "A Fuzzy Controller with
Supervised Learning Assisted Reinforcement Learning Algorithm for
Obstacle Avoidance" IEEE Trans. Syst., Man, and Cybern. B, vol. 33,
no.1, pp.17-27, 2003.
[10] Beom H. B., and Cho H. S.,”A Sensor Based Navigation for a Mobile
Robot using Fuzzy Logic and Reinforcement Learning”, IEEE Trans.
On Systems, Man, and Cybernetics, Vol. 25, No. 3, Mar. 1995.
[11] P.Y. Glorennec, " Reinforcement Learning: an Overview," in Proc.
2000, ESIT’2000, European Symposium on Intelligent Techniques, pp.
17-35, 2000.
[12] C. Watkins and P. Dayan, "Q-Learning", Machine Learning, vol. 8, pp.
279-292, 1992.
[13] K. M. Passino and S. Yurkovich, Fuzzy Control, Menlo Park:Addison
Wesley, 1998.
[14] M. Sc. Mykhaylo Konyev, "Using fuzzy Inference System as a Function
Approximator of a State Action Table," Advanced Aspects of
Theoretical Electrical Engineering, Sozopol, Bulgaria, 2005.

Thank you for copying data from http://www.arastirmax.com