MULTI ATTENTION SPATIO-TEMPORAL MODEL FOR FINE-GRAINED VIDEO RECOGNITION
卷宗概要
发明人
Marwa K. Qaraqe; Yin Yang; Elizabeth Varghese; Almiqdad Elzein
IPC 分类
CPC 分类
A multi-attention spatio-temporal model for fine-grained video recognition is disclosed. This model offers a robust solution for fine-grained video recognition by addressing the intricate challenges of simultaneously considering complex spatial and temporal information, understanding temporal relationships between frames, dynamically allocating attention to informative spatial regions and temporal segments, and adapting to varying scales and resolutions. It empowers the model to not only pinpoint “where” and “when” to focus attention but also determine “how long” to make inferences, thereby enhancing overall performance. Experiments across diverse datasets demonstrate its efficiency in interpreting complex actions and scenes, enabling precise recognition. This innovation holds promise for a wide range of applications in computer vision facilitating more accurate and insightful video analysis.
原文（中文）
A multi-attention spatio-temporal model for fine-grained video recognition is disclosed. This model offers a robust solution for fine-grained video recognition by addressing the intricate challenges of simultaneously considering complex spatial and temporal information, understanding temporal relationships between frames, dynamically allocating attention to informative spatial regions and temporal segments, and adapting to varying scales and resolutions. It empowers the model to not only pinpoint “where” and “when” to focus attention but also determine “how long” to make inferences, thereby enhancing overall performance. Experiments across diverse datasets demonstrate its efficiency in interpreting complex actions and scenes, enabling precise recognition. This innovation holds promise for a wide range of applications in computer vision facilitating more accurate and insightful video analysis.