← USPTO Patent Grants

System and method for supporting execution of batch production using reinforcement learning

Grant US12579587B2 Kind: B2 Mar 17, 2026

Assignee

Siemens Corporation

Inventors

Ting-Han Fan, Yubo Wang, Ulrich Muenz, Mathias Hakenberg

Abstract

A computer-implemented method for supporting execution of batch production by a production system includes, over a sequence of steps: acquiring a system state defined by a shop floor status, inventory status and a demand of the product types, and processing the system state using a reinforcement learned policy including a deep learning model to output a control action defining an integer batch size of a selected product type. The control action is determined by using learned parameters of the deep learning model to compute logits for a categorical distribution of predicted product types and a categorical distribution of predicted batch sizes from the system state. The logits are processed to transform the categorical distribution of predicted product types into an encoding of the selected product type and reduce the categorical distribution of predicted batch sizes into an integer batch size, for producing a next batch on the shop floor.

CPC Classifications

G06Q 50/04 G06Q 10/0875 G06Q 10/04 G06Q 10/06316

Filing Date

2022-08-26

Application No.

18685751

Claims

10