System and SoC comprising heterogeneous processors capable of processing artificial intelligence and method thereof

Abstract

According to an example of the present disclosure, a system is provided. The system may include: a plurality of heterogeneous processors configured to perform inference using a neural network model comprising a plurality of layers; a memory for storing the neural network model, wherein each layer of the neural network model comprises a plurality of parameters having different bit-widths; and a controller for assigning an operation for an arbitrary layer of the neural network model to an arbitrary processor among the plurality of heterogeneous processors. An operation for a first portion of the arbitrary layer of the neural network model may be assigned to a first processor among the plurality of heterogeneous processors. An operation for a second portion of the arbitrary layer of the neural network model may be assigned to a second processor among the plurality of heterogeneous processors. A first bit-width of a first parameter for the first portion and a second bit-width of a second parameter for the second portion may be different from each other.

CPC Classifications