AUTOMATING INTERFACES USING A COMBINATION OF REPRESENTATIONS AND GENERATIVE PRETRAINED TRANSFORMS
Applicants
UiPath, Inc.
Inventors
ADAM, Stefan, PETRE, Adrian-Valentin, MARCULET, Dan-Georgian, NGUYEN, Canh Trong, LAZA, Andrei, STANESCU, Alvin, NICOLAE, Liviu-Gabriel, FRASINEANU, Cristian, SILI, Andrei, ROMAN, Alexandru, DAMIAN, Sorin
Abstract
A method is provided. The method is executed by an automation engine implemented as a computer program within a computing environment. The method comprising includes outputting a combined screen representation to a subsequent user interface comprising demonstrations. The method comprising includes generating a step with blocks by using a large language model to match the step with action block descriptions. The method comprising includes automating the interface based on the action blocks.
IPC Classifications
Designated States
AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LI, LT, LU, LV, MC, ME, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR