Parameter optimization method, electronic device, and storage medium

Abstract

Example parameter optimization methods and apparatus are described. In one example parameter optimization method, a data processing device obtains a Kronecker factor matrix that is used to indicate a higher-order information matrix of a neural network model, and segments the Kronecker factor matrix to obtain a plurality of square matrices. The obtained plurality of square matrices are submatrices of the Kronecker factor matrix, and main diagonal lines of the plurality of square matrices each are in a one-to-one correspondence with a part of a main diagonal line of the Kronecker factor matrix. Then, the data processing device adjusts a parameter of the neural network model based on the obtained plurality of square matrices.

CPC Classifications