Vincent Gripon's Homepage

Sparse neural networks with large learning diversity

Coded recurrent neural networks with three levels of sparsity are introduced. The first level is related to the size of messages, much smaller than the number of available neurons. The second one is provided by a particular coding rule, acting as a local constraint in the neural activity. The third one is a characteristic of the low final connection density of the network after the learning phase. Though the proposed network is very simple since it is based on binary neurons and binary connections, it is able to learn a large number of messages and recall them, even in presence of strong erasures.

@article{GriBer20117,
  author = {Vincent Gripon and Claude Berrou},
  title = {Sparse neural networks with large learning
diversity},
  journal = {IEEE Transactions on Neural Networks},
  year = {2011},
  volume = {22},
  number = {7},
  pages = {1087--1096},
  month = {July},
}