Print Email Facebook Twitter Evaluation of the SUM-GAN-AAE method for Video Summarization Title Evaluation of the SUM-GAN-AAE method for Video Summarization Author Trevnenski, Georgi (TU Delft Electrical Engineering, Mathematics and Computer Science; TU Delft Intelligent Systems) Contributor Strafforello, O. (mentor) Khademi, S. (graduation committee) Höllt, T. (graduation committee) Degree granting institution Delft University of Technology Programme Computer Science and Engineering Project CSE3000 Research Project Date 2021-07-01 Abstract Video summarization is a task which many researchers have tried to automate with deep learning methods. One of these methods is the SUM-GAN-AAE algorithm developed by Apostolidis et al. which is an unsupervised machine learning method evaluated in this study. The research aims at testing the algorithm's performance on the Breakfast dataset, which is an action localization dataset, and evaluate it with rank correlation coefficients. Parameter optimization was performed to tune the learning rate of the system according to the Breakfast dataset. Then, by using k-fold cross-validation, three metrics were used to evaluate the trained model - F-Score, Kendall's τ and Spearman's ρ. Analysis of the results indicates a high F-Score as reported by the SUM-GAN-AAE paper but low rank correlation coefficients. Moreover, plotting importance scores per frame demonstrates the algorithm's inability to select key frames. The findings suggest that F-Score is not a fitting metric to use in the context of video summarization and the SUM-GAN-AAE algorithm performs poorly not only on action localization datasets but also on video summarization ones such as SumMe. Subject Video SummarizationUnsupervised learningRank CorrelationAction localization To reference this document use: http://resolver.tudelft.nl/uuid:77f7bb22-6979-4807-ab84-2636a39e5923 Part of collection Student theses Document type bachelor thesis Rights © 2021 Georgi Trevnenski Files PDF Research_paper_SUM_GAN_AA ... U_repo.pdf 397.84 KB Close viewer /islandora/object/uuid:77f7bb22-6979-4807-ab84-2636a39e5923/datastream/OBJ/view