CNIPA.AI
返回搜索
档案

METHOD AND APPARATUS FOR TRAINING IMAGE GENERATION MODEL, IMAGE GENERATION METHOD AND APPARATUS, DEVICE, AND STORAGE MEDIUM

发明专利审中
3浏览
20权利要求 · 3 独立
§ Ⅰ

卷宗概要

发明人

Chunquan Chen

IPC 分类

G6T 11/G6V 10/77G6V 10/774G6V 10/82

CPC 分类

G6T11/G6V10/7715G6V10/774G6V10/82

A method, apparatus, and computer-readable storage medium for training image generation models using varying text description complexity. The method obtains training samples containing first and second description texts corresponding to original images, where the second text contains more keywords than the first. Shallow and deep representations are extracted from the first description text using a text encoder and neural network, forming a comprehensive text representation. A diffusion model generates predicted images from this representation. The second description text is processed to extract a reference text representation. Model parameters are adjusted based on both comprehensive and reference text representations to obtain a trained image generation model capable of enhanced text-to-image generation performance.

原文(中文)

A method, apparatus, and computer-readable storage medium for training image generation models using varying text description complexity. The method obtains training samples containing first and second description texts corresponding to original images, where the second text contains more keywords than the first. Shallow and deep representations are extracted from the first description text using a text encoder and neural network, forming a comprehensive text representation. A diffusion model generates predicted images from this representation. The second description text is processed to extract a reference text representation. Model parameters are adjusted based on both comprehensive and reference text representations to obtain a trained image generation model capable of enhanced text-to-image generation performance.