MULTI ATTENTION SPATIO-TEMPORAL MODEL FOR FINE-GRAINED VIDEO RECOGNITION
案件概要
出願人
Hamad Bin Khalifa University (HBKU)
発明者
Marwa K. Qaraqe; Yin Yang; Elizabeth Varghese; Almiqdad Elzein
IPC分類
CPC分類
A multi-attention spatio-temporal model for fine-grained video recognition is disclosed. This model offers a robust solution for fine-grained video recognition by addressing the intricate challenges of simultaneously considering complex spatial and temporal information, understanding temporal relationships between frames, dynamically allocating attention to informative spatial regions and temporal segments, and adapting to varying scales and resolutions. It empowers the model to not only pinpoint “where” and “when” to focus attention but also determine “how long” to make inferences, thereby enhancing overall performance. Experiments across diverse datasets demonstrate its efficiency in interpreting complex actions and scenes, enabling precise recognition. This innovation holds promise for a wide range of applications in computer vision facilitating more accurate and insightful video analysis.
原文(中国語)
A multi-attention spatio-temporal model for fine-grained video recognition is disclosed. This model offers a robust solution for fine-grained video recognition by addressing the intricate challenges of simultaneously considering complex spatial and temporal information, understanding temporal relationships between frames, dynamically allocating attention to informative spatial regions and temporal segments, and adapting to varying scales and resolutions. It empowers the model to not only pinpoint “where” and “when” to focus attention but also determine “how long” to make inferences, thereby enhancing overall performance. Experiments across diverse datasets demonstrate its efficiency in interpreting complex actions and scenes, enabling precise recognition. This innovation holds promise for a wide range of applications in computer vision facilitating more accurate and insightful video analysis.
外部リソース