REAL-TIME SELFIE PERSPECTIVE UNDISTORTION ON MOBILES BY IM2IM TRANSLATION
개요
발명자
Jian Wang; Haiwei Chen; Sizhuo Ma; Gurunandan Krishnan Gorumkonda
IPC 분류
CPC 분류
A network and method for correcting perspective distortion of a selfie image captured with a short camera-to-face distance by processing the selfie image and generating an undistorted selfie image appearing to be taken with a longer camera-to-face distance. A pre-trained three-dimension (3D) face generative adversarial network (GAN), such as an Efficient Geometry-aware three-dimensional (EG3D), is used to generate training data. The processing pipeline is composed of two parts, a warping network and a translation network, where the warping network outputs the backward warping guidance. Backwards warping is performed on the selfie image to generate a backwards warped image, and the backwards warped image is translated to generate a face image with details fixed to obtain the final image with reduced or no image distortion.
원문 (중국어)
A network and method for correcting perspective distortion of a selfie image captured with a short camera-to-face distance by processing the selfie image and generating an undistorted selfie image appearing to be taken with a longer camera-to-face distance. A pre-trained three-dimension (3D) face generative adversarial network (GAN), such as an Efficient Geometry-aware three-dimensional (EG3D), is used to generate training data. The processing pipeline is composed of two parts, a warping network and a translation network, where the warping network outputs the backward warping guidance. Backwards warping is performed on the selfie image to generate a backwards warped image, and the backwards warped image is translated to generate a face image with details fixed to obtain the final image with reduced or no image distortion.