METHOD AND APPARATUS FOR TRAINING IMAGE GENERATION MODEL, IMAGE GENERATION METHOD AND APPARATUS, DEVICE, AND STORAGE MEDIUM

원문 (중국어)

A method, apparatus, and computer-readable storage medium for training image generation models using varying text description complexity. The method obtains training samples containing first and second description texts corresponding to original images, where the second text contains more keywords than the first. Shallow and deep representations are extracted from the first description text using a text encoder and neural network, forming a comprehensive text representation. A diffusion model generates predicted images from this representation. The second description text is processed to extract a reference text representation. Model parameters are adjusted based on both comprehensive and reference text representations to obtain a trained image generation model capable of enhanced text-to-image generation performance.