QUANTIZED NEURAL NETWORK MODEL NORMALIZATION METHOD AND SYSTEM THEREOF
Dossier Overview
Applicant
Samsung Electronics Co., Ltd.
Inventor
Chang Gwun LEE; Su Min SONG; Hyoung Jun JEON; Sang Hyuck HA
IPC Classification
CPC Classification
A neural network model normalization method may include selecting a first normalization layer included in a first model obtained by quantizing a second model; adjusting the first normalization layer; and providing the first model including the adjusted first normalization layer for deployment on an external device. The adjusting of the first normalization layer includes: adjusting a first input tensor of the first normalization layer to be normalized based on a first error between a second input tensor of a second normalization layer included in the second model and a third input tensor of a third normalization layer included in a third model obtained by dequantizing the first model; and adjusting an first output tensor of the first normalization layer to be corrected based on a second error between a second output tensor of the second normalization layer and a third output tensor of the third normalization layer.
Original (Chinese)
A neural network model normalization method may include selecting a first normalization layer included in a first model obtained by quantizing a second model; adjusting the first normalization layer; and providing the first model including the adjusted first normalization layer for deployment on an external device. The adjusting of the first normalization layer includes: adjusting a first input tensor of the first normalization layer to be normalized based on a first error between a second input tensor of a second normalization layer included in the second model and a third input tensor of a third normalization layer included in a third model obtained by dequantizing the first model; and adjusting an first output tensor of the first normalization layer to be corrected based on a second error between a second output tensor of the second normalization layer and a third output tensor of the third normalization layer.
External Resources