Re-ranking for Improved Image Query-Based Search

Re-ranking for Improved Image Query-Based Search

Zhang, QI (TU Delft Electrical Engineering, Mathematics and Computer Science; TU Delft Microelectronics)

Dauwels, J.H.G. (mentor)
Tax, D.M.J. (graduation committee)

Delft University of Technology

Electrical Engineering | Circuits and Systems

2022-08-12

In image search, an algorithm tries to identify images in a database that are similar to a query image. Image search has numerous applications. For example, image search can help historians find images of a historical building from a large image database of buildings worldwide. Feature extraction and nearest neighbors methods are standard steps in the image search task. Current state-of-the-art image search engines extract features from images through CNNs. Next, they find top-n images closest to the query image by nearest neighbor search (NN search). After NN search, the engine outputs results. However, it is still hard for current image search technologies to identify images under complicated situations, such as illumination, viewpoints, and rotation changes. These changes will reduce the accuracy of the engine. Therefore, how to improve the accuracy of the image search engine is still a challenging task.

Researchers want to design re-ranking methods for image search to improve accuracy. According to previous research, there are mainly two types of re-ranking: global feature-based re-ranking and local feature-based re-ranking. Furthermore, both types of re-ranking methods could improve the accuracy of the image search engine. However, previous re-ranking methods are not fast or accurate enough. We implement novel global and local feature-based re-ranking methods to improve the accuracy of image search significantly. We test our re-ranking methods on popular image search databases. Experiments show that our re-ranking methods improve accuracy while slightly increasing computation time.

Computer Vision
Image Search
Re-ranking

http://resolver.tudelft.nl/uuid:32e02913-ba0d-446a-9807-1129ba4a314b

Student theses

master thesis

© 2022 QI Zhang