APPARATUS AND METHOD FOR RECOGNIZING POINTING GESTURE WITH COORDINATED EYE GAZE
개요
출원인
ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
발명자
Cheol-Hwan YOO; Moon-Ki BACK; Jang-Hee YOO
IPC 분류
CPC 분류
Disclosed herein is an apparatus and method for recognizing a pointing gesture with coordinated eye gaze. The apparatus detects hand and face region images of a subject from a video input from a camera, extracts and encodes visual features of the hand and face region images, generates a visual fusion feature, in which a pointing gesture with or without coordinated eye gaze is classified, from the visual features of the hand and face region images, and learns a pointing gesture with coordinated eye gaze from the visual fusion feature by using a cross-entropy loss function.
원문 (중국어)
Disclosed herein is an apparatus and method for recognizing a pointing gesture with coordinated eye gaze. The apparatus detects hand and face region images of a subject from a video input from a camera, extracts and encodes visual features of the hand and face region images, generates a visual fusion feature, in which a pointing gesture with or without coordinated eye gaze is classified, from the visual features of the hand and face region images, and learns a pointing gesture with coordinated eye gaze from the visual fusion feature by using a cross-entropy loss function.