INTERACTIVE SPECULATIVE PLANNING

Abstract

The present disclosure generally relates to employing an interactive speculative planning system to complete a plan and execute the steps of a requested task. Systems described herein implement a fast approximation agent and an accurate target agent to generate action steps in response to receiving a request to complete a task. For each task, the approximation agent generates action steps sequentially. Simultaneously, for every step the approximation agent produces, the described system calls the target agent asynchronously to generate the next step, using the current trajectory from the approximation agent as a provisional prefix. For each action step, if the outputs of the approximation agent and the target agent match, the described system continues the process. However, if there is a mismatch, the described system halts the approximation agent, and replaces its output with the target agent's output to ensure performance is not compromised.

CPC Classifications