Parallelizing Computations of Neural Activations and Layer Normalizations in FHE Environments of Deep Learning Models
卷宗概要
申请人
International Business Machines Corporation
发明人
Itamar Zimerman; Nir Drucker
IPC 分类
CPC 分类
Parallelizing functions in deep learning models within homomorphic encryption environments is provided. The method comprises arranging layers in a deep learning model architecture. The layers comprise a first layer computed using a sign function and a second layer having components that can be pre-computed or ignored once computing the sign function on the second layer, wherein the first layer and second layer are adjacent within the deep learning model architecture. The deep learning model architecture is trained with a number of hyper-parameters, and the trained deep learning model architecture is run under homomorphic encryption.
原文(中文)
Parallelizing functions in deep learning models within homomorphic encryption environments is provided. The method comprises arranging layers in a deep learning model architecture. The layers comprise a first layer computed using a sign function and a second layer having components that can be pre-computed or ignored once computing the sign function on the second layer, wherein the first layer and second layer are adjacent within the deep learning model architecture. The deep learning model architecture is trained with a number of hyper-parameters, and the trained deep learning model architecture is run under homomorphic encryption.