METHOD AND APPARATUS FOR TRAINING IMAGE GENERATION MODEL, IMAGE GENERATION METHOD AND APPARATUS, DEVICE, AND STORAGE MEDIUM
卷宗概要
申请人
Tencent Technology (Shenzhen) Company Limited
发明人
Chunquan Chen
IPC 分类
CPC 分类
A method, apparatus, and computer-readable storage medium for training image generation models using varying text description complexity. The method obtains training samples containing first and second description texts corresponding to original images, where the second text contains more keywords than the first. Shallow and deep representations are extracted from the first description text using a text encoder and neural network, forming a comprehensive text representation. A diffusion model generates predicted images from this representation. The second description text is processed to extract a reference text representation. Model parameters are adjusted based on both comprehensive and reference text representations to obtain a trained image generation model capable of enhanced text-to-image generation performance.
原文(中文)
A method, apparatus, and computer-readable storage medium for training image generation models using varying text description complexity. The method obtains training samples containing first and second description texts corresponding to original images, where the second text contains more keywords than the first. Shallow and deep representations are extracted from the first description text using a text encoder and neural network, forming a comprehensive text representation. A diffusion model generates predicted images from this representation. The second description text is processed to extract a reference text representation. Model parameters are adjusted based on both comprehensive and reference text representations to obtain a trained image generation model capable of enhanced text-to-image generation performance.