Vincent Gripon's Homepage

Research and Teaching Blog

Associative Memories to Accelerate Approximate Nearest Neighbor Search

V. Gripon, M. Löwe and F. Vermet, "Associative Memories to Accelerate Approximate Nearest Neighbor Search," in Applied Sciences, Volume 8, Number 9, September 2018.

Nearest neighbor search is a very active field in machine learning. It appears in many application cases, including classification and object retrieval. In its naive implementation, the complexity of the search is linear in the product of the dimension and the cardinality of the collection of vectors into which the search is performed. Recently, many works have focused on reducing the dimension of vectors using quantization techniques or hashing, while providing an approximate result. In this paper, we focus instead on tackling the cardinality of the collection of vectors. Namely, we introduce a technique that partitions the collection of vectors and stores each part in its own associative memory. When a query vector is given to the system, associative memories are polled to identify which one contains the closest match. Then, an exhaustive search is conducted only on the part of vectors stored in the selected associative memory. We study the effectiveness of the system when messages to store are generated from i.i.d. uniform ±1 random variables or 0–1 sparse i.i.d. random variables. We also conduct experiments on both synthetic data and real data and show that it is possible to achieve interesting trade-offs between complexity and accuracy.

Download manuscript.

Bibtex
@article{GriLöVer20189,
  author = {Vincent Gripon and Matthias Löwe and
Franck Vermet},
  title = {Associative Memories to Accelerate
Approximate Nearest Neighbor Search},
  journal = {Applied Sciences},
  year = {2018},
  volume = {8},
  number = {9},
  month = {September},
}




You are the 1975769th visitor

Vincent Gripon's Homepage