COARSE-TO-FINE FUSION METHOD AND APPARATUS FOR VIRTUAL SPACE NAVIGATION BASED ON LANGUAGE COMMANDS
개요
출원인
INDUSTRY ACADEMY COOPERATION FOUNDATION OF SEJONG UNIVERSITY
발명자
Yong Guk KIM; Soo Mi CHOI; Anh Hoang Vo; Thanh Tin Nguyen
IPC 분류
CPC 분류
Disclosed are a coarse-to-fine fusion method and apparatus for virtual space navigation based on language commands. The coarse-to-fine fusion method for virtual space navigation based on language commands includes: (a) applying an input image to an encoder to extract first to nth visual feature maps having a hierarchical structure; (b) applying an instruction having a length of N to a language model to extract a text feature map; and (c) fusing each of the first to nth visual feature maps with the text feature map to generate an attention map.
원문 (중국어)
Disclosed are a coarse-to-fine fusion method and apparatus for virtual space navigation based on language commands. The coarse-to-fine fusion method for virtual space navigation based on language commands includes: (a) applying an input image to an encoder to extract first to nth visual feature maps having a hierarchical structure; (b) applying an instruction having a length of N to a language model to extract a text feature map; and (c) fusing each of the first to nth visual feature maps with the text feature map to generate an attention map.