Vincent Gripon's Homepage

Research and Teaching Blog

Sparse neural networks with large learning diversity

V. Gripon and C. Berrou, "Sparse neural networks with large learning diversity," in IEEE Transactions on Neural Networks, Volume 22, Number 7, pp. 1087--1096, July 2011.

Coded recurrent neural networks with three levels of sparsity are introduced. The first level is related to the size of messages, much smaller than the number of available neurons. The second one is provided by a particular coding rule, acting as a local constraint in the neural activity. The third one is a characteristic of the low final connection density of the network after the learning phase. Though the proposed network is very simple since it is based on binary neurons and binary connections, it is able to learn a large number of messages and recall them, even in presence of strong erasures.

Download manuscript.

  author = {Vincent Gripon and Claude Berrou},
  title = {Sparse neural networks with large learning
  journal = {IEEE Transactions on Neural Networks},
  year = {2011},
  volume = {22},
  number = {7},
  pages = {1087--1096},
  month = {July},

You are the 1748613th visitor

Vincent Gripon's Homepage