APPARATUS AND METHOD FOR RECOGNIZING POINTING GESTURE WITH COORDINATED EYE GAZE
案件概要
出願人
ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
発明者
Cheol-Hwan YOO; Moon-Ki BACK; Jang-Hee YOO
IPC分類
CPC分類
Disclosed herein is an apparatus and method for recognizing a pointing gesture with coordinated eye gaze. The apparatus detects hand and face region images of a subject from a video input from a camera, extracts and encodes visual features of the hand and face region images, generates a visual fusion feature, in which a pointing gesture with or without coordinated eye gaze is classified, from the visual features of the hand and face region images, and learns a pointing gesture with coordinated eye gaze from the visual fusion feature by using a cross-entropy loss function.
原文（中国語）
Disclosed herein is an apparatus and method for recognizing a pointing gesture with coordinated eye gaze. The apparatus detects hand and face region images of a subject from a video input from a camera, extracts and encodes visual features of the hand and face region images, generates a visual fusion feature, in which a pointing gesture with or without coordinated eye gaze is classified, from the visual features of the hand and face region images, and learns a pointing gesture with coordinated eye gaze from the visual fusion feature by using a cross-entropy loss function.
外部リソース