← USPTO Patent Grants

Robot arm control device, method for training hierarchical reinforcement learning model for robot arm control, and storage medium storing instructions to perform method training hierarchical reinforcement learning model for robot arm control

Grant US12583103B2 Kind: B2 Mar 24, 2026

Assignee

Agency for Defense Development

Inventors

Ganghun Lee, Byoung Tak Zhang, Minji Kim, Minsu Lee

Abstract

A robot arm control device is proposed. The robot arm control device may include a memory. The device may also include an acquisition unit acquiring an arbitrary target image, a virtual canvas image in which a virtual drawing operation of a robot arm for the target image is reflected, and a virtual nib image of the robot arm whose position is changed as the virtual drawing operation is reflected in the virtual canvas image. The device may further include a processor configured to input the target image to the pre-trained learning model, determine a position change amount of the virtual nib image in the virtual canvas image using the pre-trained learning model, and output a joint angle change amount for driving the robot arm on the basis of the position change amount.

CPC Classifications

B25J 9/163 B25J 9/1664 B25J 9/1679 B25J 9/1671 B25J 9/161 B25J 9/1653 B25J 9/1669 B25J 9/1697 B25J 11/0075 B25J 19/021 G06N 3/008 G06N 3/045 G06N 3/08 G06N 3/092 G05B 19/4205 G05B 19/4202 G05B 2219/36324

Filing Date

2023-10-19

Application No.

18490242

Claims

13