EPO Patent EP4711922A1: Automating Interfaces with LLM

ChangeBridge: EPO Bulletin - AI & Computing (G06N)

Published March 18th, 2026

Detected March 24th, 2026

Summary

The European Patent Office has published patent application EP4711922A1, filed by UiPath, Inc., detailing a method for automating interfaces using Large Language Models (LLMs) and generative models. The patent describes a system that generates interface actions based on LLM matching of step descriptions.

View original document View source feed page

What changed

The European Patent Office (EPO) has published patent application EP4711922A1, titled 'Automating interfaces using LLM and generative models,' filed by UiPath, Inc. The application details a method executed by an automation engine that uses a large language model to match step descriptions with action blocks, thereby automating interface generation and interaction. This publication represents a new patent application in the field of AI-driven automation.

This patent publication is primarily of interest to technology companies involved in AI, software development, and automation. While it does not impose immediate compliance obligations, it signifies advancements in intellectual property related to LLM applications. Companies in this space should be aware of this patent as it may affect future development and patentability in AI-driven interface automation.

Source document (simplified)

← EPO Patent Bulletin

AUTOMATING INTERFACES USING A COMBINATION OF REPRESENTATIONS AND GENERATIVE PRETRAINED TRANSFORMS

Publication EP4711922A1 Kind: A1 Mar 18, 2026

Applicants

UiPath, Inc.

Inventors

ADAM, Stefan, PETRE, Adrian-Valentin, MARCULET, Dan-Georgian, NGUYEN, Canh Trong, LAZA, Andrei, STANESCU, Alvin, NICOLAE, Liviu-Gabriel, FRASINEANU, Cristian, SILI, Andrei, ROMAN, Alexandru, DAMIAN, Sorin

Abstract

A method is provided. The method is executed by an automation engine implemented as a computer program within a computing environment. The method comprising includes outputting a combined screen representation to a subsequent user interface comprising demonstrations. The method comprising includes generating a step with blocks by using a large language model to match the step with action block descriptions. The method comprising includes automating the interface based on the action blocks.

IPC Classifications

G06F 9/451 20180101AFI20260119BHEP G06N 3/045 20230101ALI20260119BHEP G06Q 10/06 20230101ALI20260119BHEP G06F 8/35 20180101ALI20260119BHEP G06F 8/34 20180101ALI20260119BHEP

Designated States

AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LI, LT, LU, LV, MC, ME, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR

View original document →