Enhancing action discrimination via category-specific frame clustering for weakly supervised temporal action localization
Regular Papers|Updated:2024-07-11
|
Enhancing action discrimination via category-specific frame clustering for weakly supervised temporal action localization
通过类别特定帧聚类增强动作显著性的弱监督时序动作检测
“In the realm of temporal action localization (TAL), a novel method has been proposed to address the limitations of existing weakly supervised approaches when faced with an increasing number of action categories per video. This method leverages single-frame supervision by employing the K-means clustering algorithm to group annotated frames that exhibit distinctive characteristics of the same action category. These frames, serving as exemplars, enhance action discrimination and provide supplementary guidance to snippet sequence modeling. The convex combination fusion mechanism further improves the consistency of action discrimination, leading to robust class activation sequences for precise classification and localization. Experiments on THUMOS14, GTEA, and BEOID datasets demonstrate that this method outperforms current single-frame annotation-based approaches, achieving superior localization performance.”
Frontiers of Information Technology & Electronic EngineeringVol. 25, Issue 6, Pages: 809-823(2024)
Affiliations:
1.School of Computer Science and Communication Engineering, Jiangsu University, Zhenjiang 212013, China
2.Jiangsu Engineering Research Center of Big Data Ubiquitous Perception and Intelligent Agricultural Applications, Zhenjiang 212013, China
3.Changzhou Vocational Institute of Mechatronic Technology, Changzhou 213164, China