Using and Abusing Equivariance

Using and Abusing Equivariance: Investigating Differences between Exact and Approximate Equivariance in Computer Vision

Edixhoven, Tom (TU Delft Electrical Engineering, Mathematics and Computer Science)

van Gemert, J.C. (mentor)
Brinkman, W.P. (graduation committee)
Lengyel, A. (graduation committee)

Delft University of Technology

Computer Science

2023-01-27

In this work we show how Group Equivariant Convolutional Neural Networks use subsampling to learn to break equivariance to their symmetries. We focus on the 2D roto-translation group and investigate the impact of broken equivariance on network performance. We show that changing the input dimension of a network by as little as a single pixel can be enough for commonly used architectures to become approximately equivariant, rather than exactly. We investigate the impact of networks not being exactly equivariant and find that approximately equivariant networks generalise significantly worse to unseen symmetries compared to their exactly equivariant counterparts. However, when the symmetries in the training data are not identical to the symmetries of the network, we find that approximately equivariant networks are able to relax their own equivariant constraints, causing them to match or outperform exactly equivariant networks on common benchmark datasets.

Equivariance
Roto-Translation
Computer vision
Subsampling
Convolutional Neural Network

http://resolver.tudelft.nl/uuid:d6e776a8-a766-44e3-acfd-87bf1cc90fa6

Student theses

master thesis

© 2023 Tom Edixhoven