ZERO-KNOWLEDGE PROOF OF TRANFORMER MODEL BASED ON GAUGE TRANSFORMATION

Abstract

One or more inference processes may be performed in the deployment of a transformer model. For proving correctness of a transformer model inference, a ZKP may be generated in two stages. In the first stage, PoGE may be generated by canonicalizing deployed weights of the transformer model through gauge transformation to produce canonical weights. A canonical model may be generated by modifying the transformer model with the canonical weights. In the second stage, PoVI may be generated. The canonical model may be executed to generate an output from an input. The output of the canonical model may be bit-identical as the output of the transformer model for the same input despite the weight canonicalization. The ZKP for the transformer model inference may include the PoGE and PoVI. The PoGE may be generated once and used for many inference processes. The PoVI may be generated per inference.

CPC Classifications