COARSE-TO-FINE FUSION METHOD AND APPARATUS FOR VIRTUAL SPACE NAVIGATION BASED ON LANGUAGE COMMANDS

原文（中国語）

Disclosed are a coarse-to-fine fusion method and apparatus for virtual space navigation based on language commands. The coarse-to-fine fusion method for virtual space navigation based on language commands includes: (a) applying an input image to an encoder to extract first to nth visual feature maps having a hierarchical structure; (b) applying an instruction having a length of N to a language model to extract a text feature map; and (c) fusing each of the first to nth visual feature maps with the text feature map to generate an attention map.