← EPO Patent Bulletin

ATTENTION NEURAL NETWORKS WITH SPARSE ATTENTION MECHANISMS

Publication EP4121908A1 Kind: A1 Mar 18, 2026

Applicants

Google LLC

Inventors

AINSLIE, Joshua Timothy, ONTAÑÓN, Santiago, PHAM, Philip, ZAHEER, Manzil, GURUGANESH, Guru, DUBEY, Kumar Avinava, AHMED, Amr

IPC Classifications

G06N 3/045 20230101AFI20260212BHEP G06N 3/0455 20230101ALI20260212BHEP G06N 3/0495 20230101ALI20260212BHEP G06N 3/09 20230101ALI20260212BHEP G06N 3/096 20230101ALI20260212BHEP G06N 3/098 20230101ALI20260212BHEP

Designated States

AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LI, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR