← USPTO Patent Grants

Generating digital recommendations utilizing collaborative filtering, reinforcement learning, and inclusive sets of negative feedback

Grant US12586114B2 Kind: B2 Mar 24, 2026

Assignee

Adobe Inc.

Inventors

Saayan Mitra, Xiang Chen, Vahid Azizi

Abstract

The present disclosure relates to systems, methods, and non-transitory computer readable media that utilize collaborative filtering and a reinforcement learning model having an actor-critic framework to provide digital content items across client devices. In particular, in one or more embodiments, the disclosed systems monitor interactions of a client device with one or more digital content items to generate item embeddings (e.g., utilizing a collaborative filtering model). The disclosed systems further utilize a reinforcement learning model to generate a recommendation (e.g., determine one or more additional digital content items to provide to the client device) based on the user interactions. In some implementations, the disclosed systems utilize the reinforcement learning model to analyze every negative and positive interaction observed when generating the recommendation. Further, the disclosed systems utilize the reinforcement learning model to analyze item embeddings, which encode the relationships among the digital content items, when generating the recommendation.

CPC Classifications

G06Q 30/0631 G06Q 30/0202 G06Q 30/0641 G06F 18/2178 G06N 3/044 G06N 3/088

Filing Date

2021-07-02

Application No.

17367134

Claims

20