PATH PLANNING FOR MOBILE ROBOTS–BASED ON DOUBLE DUELING DEEP Q-NETWORK AND ARTIFICIAL POTENTIAL FIELD

Xin Wang∗ and Peter Xiaoping Liu∗∗

References

  1. [1] A. Loganathan and N.S. Ahmad, A systematic review on recentadvances in autonomous mobile robot navigation, EngineeringScience and Technology, An International Journal, 40(2), 2023,101343.
  2. [2] L. Liu, X. Wang, X. Yang, H. Liu, J. Li, and P. Wang,Path planning techniques for mobile robots: Review andprospect, Expert Systems with Applications, 227, 2023,120254.
  3. [3] W. Chen, J. Sun, W. Li, and D. Zhao, A real-time multi-constraints obstacle avoidance method using LiDAR, Journalof Intelligent and Fuzzy Systems, 39, 2020, 119–131.
  4. [4] B. Patle, G.L. Babu, A. Pandey, D. Parhi, and A. Jagadeesh,A review: On path planning strategies for navigation of mobilerobot, Defence Technology, 15(4), 2019, 582–606.
  5. [5] K. Karur, N. Sharma, C. Dharmatti, and J.E. Siegel, A surveyof path planning algorithms for mobile robots, Vehicles, 3,2021, 448–468.
  6. [6] E.W. Dijkstra, A note on two problems in connexion withgraphs, Numerische Mathematik, 1(1), 1959, 269–271.
  7. [7] P.E. Hart, N.J. Nilsson, and B. Raphael, A formal basis forthe heuristic determination of minimum cost paths, IEEETransactions on Systems Science & Cybernetics, 4(2), 1972,28–29.
  8. [8] O. Castillo and T.P. Melin, Multiple objective geneticalgorithms for path-planning optimisation in autonomousmobile robots, Soft Computing-A Fusion of Foundations,Methodologies & Applications, 11, 2007, 269–279.
  9. [9] W. Burgard, Controlling synchro-drive robots with thedynamic window approach to collision avoidance, IEEE/RSJInternational Conference on Intelligent Robots & Systems, 3,2002, 1280–1287.
  10. [10] S.M. Lavalle, Rapidly-Exploring Random Trees: A New Toolfor Path Planning, The Annual Research Report, Iowa StateUniversity, Ames, IA, 1998.
  11. [11] O. Khatib, Real-time obstacle avoidance for manipulators andmobile robots, The International Journal of Robotics Research,5, 1985, 90–98.
  12. [12] V. Mnih, K. Kavukcuoglu, D. Silver, A.A. Rusu, J. Veness,M.G. Bellemare, A. Graves, M. Riedmiller, A.K. Fidjeland,G. Ostrovski, S. Petersen, C. Beattie, A. Sadik, I. Antonoglou,H. King, D. Kumaran, D. Wierstra, S. Legg, and D. Hassabis,Human-level control through deep reinforcement learning,Nature, 518, 2015, 529–533.
  13. [13] V.N. Sichkar, Reinforcement learning algorithms in global pathplanning for mobile robot, in Proceeding of the InternationalConference on Industrial Engineering, Applications andManufacturing (ICIEAM), Sochi, 2019, 1–5.
  14. [14] Z. Chu, F. Wang, T. Lei, and C. Luo, Path planning basedon deep reinforcement learning for autonomous underwatervehicles under ocean current disturbance, IEEE Transactionson Intelligent Vehicles, 8, 2023, 108–120.
  15. [15] H. V. Hasselt, A. Guez, and D. Silver, Deep reinforcementlearning with double Q-learning, in Proceeding of the AAAIConference on Artificial Intelligence, Phoenix, AZ, 2015, 2094–2100.
  16. [16] Q. Wei, R. Song, P. Zhang, Z. Wu, R. Huang, C. Qin,J.L. Li, and X. Lan, “Path planning of mobile robot in unknowndynamic continuous environment using reward-modified deepQ-network,” Optimal Control Applications and Methods, 44,2021, 1570–1587.
  17. [17] C. Lv, X. Fan, and M. Sun, A fusion algorithm for path planningof mobile robots in environments with dynamic obstacles,International Journal of Robotics and Automation, 39, 2024,94–105.
  18. [18] R.H. Abiyev, N. Akkaya, E. Ayta¸c, and D. Ibrahim, Behaviourtree based control for efficient navigation of holonomic robots,International Journal of Robotics and Automation, 29, 2014,44–57.
  19. [19] H. Huang and C. Jin, A novel particle swarm optimisationalgorithm based on reinforcement learning mechanism for AUVpath planning, Complexity, 2021, 2021, 1–13.
  20. [20] T. Schaul, J. Quan, I. Antonoglou, and D. Silver, Prioritisedexperience replay, Computer Science, 2015, in press.
  21. [21] M. Jianfei, Discerning Temporal Difference Learning, 2023,arXiv:2310.08091.
  22. [22] C.J.C.H. Watkins and P. Dayan, Technical note: Q-learning,Machine Learning, 8, 2004, 279–292.
  23. [23] Z. Wang, N.D. Freitas, and M. Lanctot, Dueling networkarchitectures for deep reinforcement learning, in Proceeding ofthe International Conference on Machine Learning, New York,NY, 2015, 1995–2003.
  24. [24] F. Dunn and I. Parberry, 3D Math Primer for Graphics andGame Development, 2nd ed. (Boca Raton, FL: CRC Press,2011).

Important Links:

Go Back