USING COMPRESSED REPRESENTATIONS TO ADAPT GENERATIVE MODELS TO NEW CONTEXT DATA

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for performing a task. In one aspect, a method comprises: receiving a query for a task to be performed; receiving a plurality of context content items for the task; for each content item of the plurality of content items, processing an input comprising a representation of the content item using a trained compression model to generate a compressed representation of the content item comprising one or more vectors of a fixed size; generating, using the compressed representations, an aggregated compressed representation comprising one or more vectors that represents the plurality of content items; and processing an input comprising (i) the query and (ii) the aggregated compressed representation using a generative neural network to generate a response to the query.

CPC Classifications