SOUNDING OBJECT FOCUSED SEGMENTATION FOR AN AUDIO-VISUAL SCENE
案件概要
出願人
International Business Machines Corporation
発明者
Shi Yun Liang; Yuan Yuan Ding; Yong Sun; Zhong Yuan Sun; Jing Zhang
IPC分類
CPC分類
An image feature vector for a given video frame is generated from a given video and an audio feature vector for audio of the given video is generated. A textual description of the given video frame is generated and textual feature vectors are generated from the textual description. A first set of audio features of the audio feature vector and visual features of the image feature vector are fused to generate fused audio-visual features. A second set of audio features of the audio feature vector and the textual feature vectors are fused to generate fused audio-text features. A final mask is generated based on the fused audio-visual features and the fused audio-text features.
原文(中国語)
An image feature vector for a given video frame is generated from a given video and an audio feature vector for audio of the given video is generated. A textual description of the given video frame is generated and textual feature vectors are generated from the textual description. A first set of audio features of the audio feature vector and visual features of the image feature vector are fused to generate fused audio-visual features. A second set of audio features of the audio feature vector and the textual feature vectors are fused to generate fused audio-text features. A final mask is generated based on the fused audio-visual features and the fused audio-text features.
ログインして全文を読む
請求項 1 を表示しています。無料登録で全 20 項の請求項、明細書全文、全図面、翻訳、法的状態を閲覧できます。
- 全請求項
- 図面の説明
外部リソース