TECHNIQUE FOR CONCEPT AND STYLE PRE-TRAINING FOR A PERCEPTION TASK

Abstract

Systems and methods for pre-training a principal encoder and a concept head. A method comprises receiving, at a principal encoder, a medical image and processing it for obtaining a principal latent representation, which is provided to a concept head and to a style head to obtain a first vector of discretized anatomical concepts and an associated further first vector of continuous styles per discretized anatomical concept in the medical image, respectively. An auxiliary feature decoder determines, based on the first vector of discretized anatomical concepts, an auxiliary latent representation, based on which an auxiliary image decoder performs a reconstruction of the medical image. The principal encoder and concept head are pre-trained based a reconstruction loss between the received medical image and the first reconstruction.

CPC Classifications