TY - JOUR
T1 - 深度强化学习的机械臂密集场景多物体抓取方法
AU - Li, Xin
AU - Shen, Jie
AU - Cao, Kai
AU - Li, Tao
N1 - Publisher Copyright:
© 2024 Journal of Computer Engineering and Applications Beijing Co., Ltd.; Science Press. All rights reserved.
PY - 2024/12/1
Y1 - 2024/12/1
N2 - Robots are prone to collisions while grasping objects in cluttered scenes, relying on pushing to create space for grasping. Existing push-grasping collaborative methods demonstrate low sample efficiency and grasping success rates. To address these problems, a new deep reinforcement learning method based on DDQN (double deep Q network) is proposed to efficiently learn excellent push-grasp cooperative strategies. The system incorporates a mask function that screens effective actions, allowing the robot to focus on samples that facilitate efficient learning. Additionally, the push reward function is designed using the difference between the average relative distances of all objects in the workspace before and after pushing, which allows for a more precise assessment of the impact of candidate pushing on density. The experimental results of the method with VPG (visual pushing grasping) are analyzed to show that the proposed method accelerates the training process while improving the grasping success rate, and verify that the system can be fully adapted to real world.
AB - Robots are prone to collisions while grasping objects in cluttered scenes, relying on pushing to create space for grasping. Existing push-grasping collaborative methods demonstrate low sample efficiency and grasping success rates. To address these problems, a new deep reinforcement learning method based on DDQN (double deep Q network) is proposed to efficiently learn excellent push-grasp cooperative strategies. The system incorporates a mask function that screens effective actions, allowing the robot to focus on samples that facilitate efficient learning. Additionally, the push reward function is designed using the difference between the average relative distances of all objects in the workspace before and after pushing, which allows for a more precise assessment of the impact of candidate pushing on density. The experimental results of the method with VPG (visual pushing grasping) are analyzed to show that the proposed method accelerates the training process while improving the grasping success rate, and verify that the system can be fully adapted to real world.
KW - deep reinforcement learning
KW - dense scenes
KW - manipulator
KW - synergies between pushing and grasping
UR - http://www.scopus.com/inward/record.url?scp=105007334087&partnerID=8YFLogxK
U2 - 10.3778/j.issn.1002-8331.2307-0326
DO - 10.3778/j.issn.1002-8331.2307-0326
M3 - 文章
AN - SCOPUS:105007334087
SN - 1002-8331
VL - 60
SP - 325
EP - 332
JO - Computer Engineering and Applications
JF - Computer Engineering and Applications
IS - 23
ER -