Print Email Facebook Twitter Learning Scale-Aware Optical Flow Title Learning Scale-Aware Optical Flow Author Wen, Xiaoming (TU Delft Electrical Engineering, Mathematics and Computer Science) Contributor Reinders, M.J.T. (mentor) van Gemert, J.C. (mentor) Loog, M. (graduation committee) Hanjalic, A. (graduation committee) Degree granting institution Delft University of Technology Date 2018-11-28 Abstract Optical flow is a representation of projected real-world motion of the object between two consecutive images. The optical flow measures the pixel displacement on the image coordinate plane. However, it does not reveal the motion in depth explicitly, which could be useful as input in some tasks such as vehicle tracking. To extend the original optical flow approach, we model the depth change of the object as the scale change of object in the image and present an approach to estimate the scale change and optical flow jointly. Considering the scenario that obvious scale change occurs between two images, the traditional convolution network fails because it lacks the scale invariance. According to the Scale-space theory and the idea of learning a combination of Gaussian derivative basis to approximate arbitrary filters, we build a Basis Convolution layer that allows the network to see the scale change between two images and make use of it to better capture the same feature with various scales on two images.We test our models on our own optical flow datasets which involve obvious scale change. According to the experimental results, our method is capable of estimating the scale change between images, and it significantly improves the optical flow estimation by modelling the scale change explicitly. Subject Optica FlowCNNScale-AwareDerivative To reference this document use: http://resolver.tudelft.nl/uuid:7e29ed6a-b1d8-490b-bfa0-b576e6e7887c Part of collection Student theses Document type master thesis Rights © 2018 Xiaoming Wen Files PDF corrected_thesis_report_x ... g_wen..pdf 3.48 MB Close viewer /islandora/object/uuid:7e29ed6a-b1d8-490b-bfa0-b576e6e7887c/datastream/OBJ/view