Journal Papers
2022
Y. Bendou, Y. Hu, R. Lafargue, G. Lioi, B. Pasdeloup, S. Pateux and V. Gripon, "Easy—Ensemble AugmentedShotYShaped Learning: StateoftheArt FewShot Classification with Simple Components," in MDPI Journal of Imaging, Volume 8, Number 7, July 2022.
Manuscript.
2021
2018
A. Mheich, M. Hassan, M. Khalil, V. Gripon, O. Dufor and F. Wendling, "SimiNet: a Novel Method for Quantifying Brain Network Similarity," in IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 40, Number 9, pp. 22382249, September 2018.
2016
2015
2014
H. Jarollahi, N. Onizawa, V. Gripon, N. Sakimura, T. Sugibayashi, T. Endoh, H. Ohno, T. Hanyu and W. J. Gross, "A NonVolatile Associative MemoryBased ContextDriven Search Engine Using 90 nm CMOS MTJHybrid LogicinMemory Architecture," in Journal on Emerging and Selected Topics in Circuits and Systems, Volume 4, pp. 460474, 2014.
Manuscript.
2011

Y. Bendou, Y. Hu, R. Lafargue, G. Lioi, B. Pasdeloup, S. Pateux and V. Gripon, "Easy—Ensemble AugmentedShotYShaped Learning: StateoftheArt FewShot Classification with Simple Components," in MDPI Journal of Imaging, Volume 8, Number 7, July 2022.
Fewshot classification aims at leveraging knowledge learned in a deep learning model, in order to obtain good classification performance on new problems, where only a few labeled samples per class are available. Recent years have seen a fair number of works in the field, each one introducing their own methodology. A frequent problem, though, is the use of suboptimally trained models as a first building block, leading to doubts about whether proposed approaches bring gains if applied to more sophisticated pretrained models. In this work, we propose a simple way to train such models, with the aim of reaching top performance on multiple standardized benchmarks in the field. This methodology offers a new baseline on which to propose (and fairly compare) new techniques or adapt existing ones.
Download manuscript.
Bibtex@article{BenHuLafLioPasPatGri20227,
author = {Yassir Bendou and Yuqing Hu and Raphael
Lafargue and Giulia Lioi and Bastien Pasdeloup and
Stéphane Pateux and Vincent Gripon},
title = {Easy—Ensemble AugmentedShotYShaped
Learning: StateoftheArt FewShot Classification
with Simple Components},
journal = {MDPI Journal of Imaging},
year = {2022},
volume = {8},
number = {7},
month = {July},
}

In many reallife problems, it is difficult to acquire or label large amounts of data, resulting in socalled fewshot learning problems. However, fewshot classification is a challenging problem due to the uncertainty caused by using few labeled samples. In the past few years, many methods have been proposed with the common aim of transferring knowledge acquired on a previously solved task, which is often achieved by using a pretrained feature extractor. As such, if the initial task contains many labeled samples, it is possible to circumvent the limitations of fewshot learning. A shortcoming of existing methods is that they often require priors about the data distribution, such as the balance between considered classes. In this paper, we propose a novel transferbased method with a double aim: providing stateoftheart performance, as reported on standardized datasets in the field of fewshot learning, while not requiring such restrictive priors. Our methodology is able to cope with both inductive cases, where prediction is performed on test samples independently from each other, and transductive cases, where a joint (batch) prediction is performed.
Download manuscript.
Bibtex@article{HuPatGri20224,
author = {Yuqing Hu and Stéphane Pateux and Vincent
Gripon},
title = {Squeezing Backbone Feature Distributions to
the Max for Efficient FewShot Learning},
journal = {Algorithms},
year = {2022},
volume = {15},
number = {5},
month = {April},
}

Introduced in the late 80's for generalization purposes, pruning has now become a staple to compress deep neural networks. Despite many innovations brought in the last decades, pruning approaches still face core issues that hinder their performance or scalability. Drawing inspiration from early work in the field, and especially the use of weightdecay to achieve sparsity, we introduce Selective Weight Decay (SWD), which realizes efficient continuous pruning throughout training. Our approach, theoreticallygrounded on Lagrangian Smoothing, is versatile and can be applied to multiple tasks, networks and pruning structures. We show that SWD compares favorably to stateoftheart approaches in terms of performance/parameters ratio on the CIFAR10, Cora and ImageNet ILSVRC2012 datasets.
Download manuscript.
Bibtex@article{TesGriLéArzHanBer20223,
author = {Hugo Tessier and Vincent Gripon and
Mathieu Léonardon and Matthieu Arzel and Thomas
Hannagan and David Bertrand},
title = {Rethinking Weight Decay For Efficient
Neural Network Pruning},
journal = {Journal of Imaging},
year = {2022},
volume = {8},
number = {3},
month = {March},
}

For the past few years, deep learning (DL) robustness (i.e. the ability to maintain the same decision when inputs are subject to perturbations) has become a question of paramount importance, in particular in settings where misclassification can have dramatic consequences. To address this question, authors have proposed different approaches, such as adding regularizers or training using noisy examples. In this paper we introduce a regularizer based on the Laplacian of similarity graphs obtained from the representation of training data at each layer of the DL architecture. This regularizer penalizes large changes (across consecutive layers in the architecture) in the distance between examples of different classes, and as such enforces smooth variations of the class boundaries. We provide theoretical justification for this regularizer and demonstrate its effectiveness to improve robustness on classical supervised learning vision datasets for various types of perturbations. We also show it can be combined with existing methods to increase overall robustness.
Download manuscript.
Bibtex@article{LasGriOrt2021,
author = {Carlos Lassance and Vincent Gripon and
Antonio Ortega},
title = {Laplacian networks: Bounding indicator
function smoothness for neural networks robustness},
journal = {APSIPA Transactions on Signal and
Information Processing},
year = {2021},
volume = {10},
}

In the context of fewshot learning, one cannot measure the generalization ability of a trained classifier using validation sets, due to the small number of labeled samples. In this paper, we are interested in finding alternatives to answer the question: is my classifier generalizing well to new data? We investigate the case of transferbased fewshot learning solutions, and consider three settings:(i) supervised where we only have access to a few labeled samples,(ii) semisupervised where we have access to both a few labeled samples and a set of unlabeled samples and (iii) unsupervised where we only have access to unlabeled samples. For each setting, we propose reasonable measures that we empirically demonstrate to be correlated with the generalization ability of the considered classifiers. We also show that these simple measures can predict the generalization ability up to a certain confidence. We conduct our experiments on standard fewshot vision datasets.
Download manuscript.
Bibtex@article{BonBéGri2021,
author = {Myriam Bontonou and Louis Béthune and
Vincent Gripon},
title = {Predicting the Generalization Ability of a
FewShot Classifier},
journal = {Information},
year = {2021},
volume = {12},
number = {1},
}

Deep Learning (DL) has attracted a lot of attention for its ability to reach stateoftheart performance in many machine learning tasks. The core principle of DL methods consists of training composite architectures in an endtoend fashion, where inputs are associated with outputs trained to optimize an objective function. Because of their compositional nature, DL architectures naturally exhibit several intermediate representations of the inputs, which belong to socalled latent spaces. When treated individually, these intermediate representations are most of the time unconstrained during the learning process, as it is unclear which properties should be favored. However, when processing a batch of inputs concurrently, the corresponding set of intermediate representations exhibit relations (what we call a geometry) on which desired properties can be sought. In this work, we show that it is possible to introduce constraints on these latent geometries to address various problems. In more detail, we propose to represent geometries by constructing similarity graphs from the intermediate representations obtained when processing a batch of inputs. By constraining these Latent Geometry Graphs (LGGs), we address the three following problems: (i) reproducing the behavior of a teacher architecture is achieved by mimicking its geometry, (ii) designing efficient embeddings for classification is achieved by targeting specific geometries, and (iii) robustness to deviations on inputs is achieved via enforcing smooth variation of geometry between consecutive latent spaces. Using standard vision benchmarks, we demonstrate the ability of the proposed geometrybased methods in solving the considered problems.
Download manuscript.
Bibtex@article{LasGriOrt2021,
author = {Carlos Lassance and Vincent Gripon and
Antonio Ortega},
title = {Representing Deep Neural Networks Latent
Space Geometries with Graphs},
journal = {Algorithms},
year = {2021},
volume = {14},
number = {2},
}

Visionbased localization is the problem of inferring the pose of the camera given a single image. One commonly used approach relies on image retrieval where the query input is compared against a database of localized support examples and its pose is inferred with the help of the retrieved items. This assumes that images taken from the same places consist of the same landmarks and thus would have similar feature representations. These representations can learn to be robust to different variations in capture conditions like time of the day or weather. In this work, we introduce a framework which aims at enhancing the performance of such retrievalbased localization methods. It consists in taking into account additional information available, such as GPS coordinates or temporal proximity in the acquisition of the images. More precisely, our method consists in constructing a graph based on this additional information that is later used to improve reliability of the retrieval process by filtering the feature representations of support and/or query images. We show that the proposed method is able to significantly improve the localization accuracy on two large scale datasets, as well as the mean average precision in classical image retrieval scenarios.
Download manuscript.
Bibtex@article{LasLatGarGriRei2021,
author = {Carlos Lassance and Yasir Latif and Ravi
Garg and Vincent Gripon and Ian Reid},
title = {Improved Visual Localization via Graph
Filtering},
journal = {Journal of Imaging},
year = {2021},
volume = {7},
number = {2},
}

Recently authors have introduced the idea of training discrete weights neural networks using a mix between classical simulated annealing and a replica ansatz known from the statistical physics literature. Among other points, they claim their method is able to find robust configurations. In this paper, we analyze this so called “replicated simulated annealing” algorithm. In particular, we give criteria to guarantee its convergence, and study when it successfully samples from configurations. We also perform experiments using synthetic and real data bases.
Download manuscript.
Bibtex@article{GriLöVer2021,
author = {Vicent Gripon and Matthias Löwe and
Franck Vermet},
title = {Some Remarks on Replicated Simulated
Annealing},
journal = {Journal of Statistical Physics},
year = {2021},
volume = {182},
number = {3},
pages = {122},
}

Deep Neural Networks are stateoftheart in a large number of challenges in machine learning. However, to reach the best performance they require a huge pool of parameters. Indeed, typical deep convolutional architectures present an increasing number of feature maps as we go deeper in the network, whereas spatial resolution of inputs is decreased through downsampling operations. This means that most of the parameters lay in the final layers, while a large portion of the computations are performed by a small fraction of the total parameters in the first layers. In an effort to use every parameter of a network at its maximum, we propose a new convolutional neural network architecture, called ThriftyNet. In ThriftyNet, only one convolutional layer is defined and used recursively, leading to a maximal parameter factorization. In complement, normalization, nonlinearities, downsamplings and shortcut ensure sufficient expressivity of the model. ThriftyNet achieves competitive performance on a tiny parameters budget, exceeding 91% accuracy on CIFAR10 with less than 40 k parameters in total, 74.3% on CIFAR100 with less than 600 k parameters, and 67.1% On ImageNet ILSVRC 2012 with no more than 4.15 M parameters. However, the proposed method typically requires more computations than existing counterparts.
Download manuscript.
Bibtex@article{CoiHacGri2021,
author = {Guillaume Coiffier and Ghouthi Boukli
Hacene and Vincent Gripon},
title = {ThriftyNets: Convolutional Neural Networks
with Tiny Parameter Budget},
journal = {IoT},
year = {2021},
volume = {2},
number = {2},
}

The application of graph theory to model the complex structure and function of the brain has shed new light on its organization, prompting the emergence of network neuroscience. Despite the tremendous progress that has been achieved in this field, still relatively few methods exploit the topology of brain networks to analyze brain activity. Recent attempts in this direction have leveraged on the one hand graph spectral analysis (to decompose brain connectivity into eigenmodes or gradients) and the other graph signal processing (to decompose brain activity "coupled to" an underlying network in graph Fourier modes). These studies have used a variety of imaging techniques (e.g., fMRI, electroencephalography, diffusionweighted and myelinsensitive imaging) and connectivity estimators to model brain networks. Results are promising in terms of interpretability and functional relevance, but methodologies and terminology are variable. The goals of this paper are twofold. First, we summarize recent contributions related to connectivity gradients and graph signal processing, and attempt a clarification of the terminology and methods used in the field, while pointing out current methodological limitations. Second, we discuss the perspective that the functional relevance of connectivity gradients could be fruitfully exploited by considering them as graph Fourier bases of brain activity.
Download manuscript.
Bibtex@article{LioGriBraRouFar20213,
author = {Giulia Lioi and Vincent Gripon and
Abdelbasset Brahim and François Rousseau and Nicolas
Farrugia},
title = {Gradients of connectivity as graph Fourier
bases of brain activity },
journal = {Network Neuroscience},
year = {2021},
volume = {5},
number = {2},
pages = {322336},
month = {March},
}

Embedding Artificial Intelligence onto lowpower devices is a challenging task that has been partly overcome with recent advances in machine learning and hardware design. Presently, deep neural networks can be deployed on embedded targets to perform different tasks such as speech recognition, object detection or Human Activity Recognition. However, there is still room for optimization of deep neural networks onto embedded devices. These optimizations mainly address power consumption, memory and realtime constraints, but also an easier deployment at the edge. Moreover, there is still a need for a better understanding of what can be achieved for different use cases. This work focuses on quantization and deployment of deep neural networks onto lowpower 32bit microcontrollers. The quantization methods, relevant in the context of an embedded execution onto a microcontroller, are first outlined. Then, a new framework for endtoend deep neural networks training, quantization and deployment is presented. This framework, called MicroAI, is designed as an alternative to existing inference engines (TensorFlow Lite for Microcontrollers and STM32Cube.AI). Our framework can indeed be easily adjusted and/or extended for specific use cases. Execution using single precision 32bit floatingpoint as well as fixedpoint on 8 and 16 bits integers are supported. The proposed quantization method is evaluated with three different datasets (UCIHAR, Spoken MNIST and GTSRB). Finally, a comparison study between MicroAI and both existing embedded inference engines is provided in terms of memory and power efficiency. Ondevice evaluation is done using ARM CortexM4Fbased microcontrollers (Ambiq Apollo3 and STM32L452RE).
Download manuscript.
Bibtex@article{NovHacPegMirGri20211,
author = {PierreEmmanuel Novac and Ghouthi Boukli
Hacene and Alain Pegatoquet and Benoît Miramond and
Vincent Gripon},
title = {Quantization and Deployment of Deep Neural
Networks on Microcontrollers},
journal = {Sensors},
year = {2021},
volume = {21},
number = {9},
month = {January},
}

Deep learningbased methods have reached state of the art performances, relying on a large quantity of available data and computational power. Such methods still remain highly inappropriate when facing a major open machine learning problem, which consists of learning incrementally new classes and examples over time. Combining the outstanding performances of Deep Neural Networks (DNNs) with the flexibility of incremental learning techniques is a promising venue of research. In this contribution, we introduce Transfer Incremental Learning using Data Augmentation (TILDA). TILDA is based on pretrained DNNs as feature extractors, robust selection of feature vectors in subspaces using a nearestclassmean based technique, majority votes and data augmentation at both the training and the prediction stages. Experiments on challenging vision datasets demonstrate the ability of the proposed method for low complexity incremental learning, while achieving significantly better accuracy than existing incremental counterparts.
Download manuscript.
Bibtex@article{HacGriFarArzJez2018,
author = {Ghouthi Boukli Hacene and Vincent Gripon
and Nicolas Farrugia and Matthieu Arzel and Michel
Jezequel},
title = {Transfer Incremental Learning Using Data
Augmentation},
journal = {Applied Sciences},
year = {2018},
volume = {8},
number = {12},
}

We study an indexing architecture to store and search in a database of highdimensional vectors from the perspective of statistical signal processing and decision theory. This architecture is composed of several memory units, each of which summarizes a fraction of the database by a single representative vector. The potential similarity of the query to one of the vectors stored in the memory unit is gauged by a simple correlation with the memory unit’s representative vector. This representative optimizes the test of the following hypothesis: the query is independent from any vector in the memory unit vs. the query is a simple perturbation of one of the stored vectors. Compared to exhaustive search, our approach finds the most similar database vectors significantly faster without a noticeable reduction in search quality. Interestingly, the reduction of complexity is provably better in highdimensional spaces. We empirically demonstrate its practical interest in a largescale image search scenario with offtheshelf stateoftheart descriptors.
Bibtex@article{IscFurGriRabJé2018,
author = {Ahmet Iscen and Teddy Furon and Vincent
Gripon and Michael Rabbat and Hervé Jégou},
title = {Memory vectors for similarity search in
highdimensional spaces},
journal = {IEEE Transactions on Big Data},
year = {2018},
pages = {6577},
}

Nearest neighbor search is a very active field in machine learning. It appears in many application cases, including classification and object retrieval. In its naive implementation, the complexity of the search is linear in the product of the dimension and the cardinality of the collection of vectors into which the search is performed. Recently, many works have focused on reducing the dimension of vectors using quantization techniques or hashing, while providing an approximate result. In this paper, we focus instead on tackling the cardinality of the collection of vectors. Namely, we introduce a technique that partitions the collection of vectors and stores each part in its own associative memory. When a query vector is given to the system, associative memories are polled to identify which one contains the closest match. Then, an exhaustive search is conducted only on the part of vectors stored in the selected associative memory. We study the effectiveness of the system when messages to store are generated from i.i.d. uniform ±1 random variables or 0–1 sparse i.i.d. random variables. We also conduct experiments on both synthetic data and real data and show that it is possible to achieve interesting tradeoffs between complexity and accuracy.
Download manuscript.
Bibtex@article{GriLöVer20189,
author = {Vincent Gripon and Matthias Löwe and
Franck Vermet},
title = {Associative Memories to Accelerate
Approximate Nearest Neighbor Search},
journal = {Applied Sciences},
year = {2018},
volume = {8},
number = {9},
month = {September},
}

A. Mheich, M. Hassan, M. Khalil, V. Gripon, O. Dufor and F. Wendling, "SimiNet: a Novel Method for Quantifying Brain Network Similarity," in IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 40, Number 9, pp. 22382249, September 2018.
Quantifying the similarity between two networks is critical in many applications. A number of algorithms have been proposed to compute graph similarity, mainly based on the properties of nodes and edges. Interestingly, most of these algorithms ignore the physical location of the nodes, which is a key factor in the context of brain networks involving spatially defined functional areas. In this paper, we present a novel algorithm called "SimiNet" for measuring similarity between two graphs whose nodes are defined a priori within a 3D coordinate system. SimiNet provides a quantified index (ranging from 0 to 1) that accounts for node, edge and spatiality features. Complex graphs were simulated to evaluate the performance of SimiNet that is compared with eight stateofart methods. Results show that SimiNet is able to detect weak spatial variations in compared graphs in addition to computing similarity using both nodes and edges. SimiNet was also applied to real brain networks obtained during a visual recognition task. The algorithm shows high performance to detect spatial variation of brain networks obtained during a naming task of two categories of visual stimuli: animals and tools. A perspective to this work is a better understanding of object categorization in the human brain.
Bibtex@article{MheHasKhaGriDufWen201809,
author = {Ahmad Mheich and Mahmoud Hassan and
Mohamad Khalil and Vincent Gripon and Olivier Dufor
and Fabrice Wendling},
title = {SimiNet: a Novel Method for Quantifying
Brain Network Similarity},
journal = {IEEE Transactions on Pattern Analysis and
Machine Intelligence},
year = {2018},
volume = {40},
number = {9},
pages = {22382249},
month = {September},
}

Many tools from the field of graph signal processing exploit knowledge of the underlying graph’s structure (e.g., as encoded in the Laplacian matrix) to process signals on the graph. Therefore, in the case when no graph is available, graph signal processing tools cannot be used anymore. Researchers have proposed approaches to infer a graph topology from observations of signals on its vertices. Since the problem is illposed, these approaches make assumptions, such as smoothness of the signals on the graph, or sparsity priors. In this paper, we propose a characterization of the space of valid graphs, in the sense that they can explain stationary signals. To simplify the exposition in this paper, we focus here on the case where signals were i.i.d. at some point back in time and were observed after diffusion on a graph. We show that the set of graphs verifying this assumption has a strong connection with the eigenvectors of the covariance matrix, and forms a convex set. Along with a theoretical study in which these eigenvectors are assumed to be known, we consider the practical case when the observations are noisy, and experimentally observe how fast the set of valid graphs converges to the set obtained when the exact eigenvectors are known, as the number of observations grows. To illustrate how this characterization can be used for graph recovery, we present two methods for selecting a particular point in this set under chosen criteria, namely graph simplicity and sparsity. Additionally, we introduce a measure to evaluate how much a graph is adapted to signals under a stationarity assumption. Finally, we evaluate how stateoftheart methods relate to this framework through experiments on a dataset of temperatures.
Download manuscript.
Bibtex@article{PasGriMerPasRab201809,
author = {Bastien Pasdeloup and Vincent Gripon and
Grégoire Mercier and Dominique Pastor and Michael
Rabbat},
title = {Characterization and Inference of Graph
Diffusion Processes from Observations of Stationary
Signals},
journal = {IEEE Transactions on Signal and
Information Processing over Networks},
year = {2018},
volume = {4},
number = {3},
pages = {481496},
month = {September},
}

We propose a lowpower contentaddressable memory (CAM) employing a new algorithm for associativity between the input tag and the corresponding address of the output data. The proposed architecture is based on a recently developed sparse clustered network using binary connections that onaverage eliminates most of the parallel comparisons per formed during a search. Therefore, the dynamic energy con sumption of the proposed design is significantly lower compared with that of a conventional lowpower CAM design. Given an input tag, the proposed architecture computes a few possibilities for the location of the matched tag and performs the comparisons on them to locate a single valid match. TSMC 65nm CMOS tech nology was used for simulation purposes. Following a selection of design parameters, such as the number of CAM entries, the energy consumption and the search delay of the proposed design are 8%, and 26% of that of the conventional NAND architecture, respectively, with a 10% area overhead. A design methodology based on the silicon area and power budgets, and performance requirements is discussed.
Download manuscript.
Bibtex@article{JarGriOniGro2016,
author = {Hooman Jarollahi and Vincent Gripon and
Naoya Onizawa and Warren J. Gross},
title = {Algorithm and Architecture for a LowPower
ContentAddressable Memory Based on SparseClustered
Networks},
journal = {Transactions on Very Large Scale
Integration Systems},
year = {2016},
volume = {27},
number = {2},
pages = {375387},
}

An extension to a recently introduced architecture of cliquebased neural networks is presented. This extension makes it possible to store sequences with high eff i ciency. To obtain this property, network connections are provided with orientation and with f l exible redundancy carried by both spatial and temporal redundancy, a mechanism of anticipation being introduced in the model. In addition to the sequence storage with high efficiency, this new scheme also offers biological plausibility. In order to achieve accurate sequence retrieval, a double layered structure combining heteroassociation and autoassociation is also proposed.
Download manuscript.
Bibtex@article{JiaGriBerRab2016,
author = {Xiaoran Jiang and Vincent Gripon and
Claude Berrou and Michael Rabbat},
title = {Storing sequences in binary
tournamentbased neural networks},
journal = {IEEE Transactions on Neural Networks and
Learning Systems},
year = {2016},
volume = {27},
number = {5},
pages = {913925},
}

Associative memories are datastructures that allow retrieval of previously stored messages given part of their content. They thus behave similarly to human brain’s memory that is capable, for instance, of retrieving the end of a song given its beginning. Among different families of associative memories, sparse ones are known to provide the best efficiency (ratio of the number of bits stored to that of bits used). Recently, a new family of sparse associative memories achieving almostoptimal efficiency has been proposed. Their structure induces a direct mapping between input messages and stored patterns. Nevertheless, it is well known that nonuniformity of the stored messages can lead to dramatic decrease in performance. In this work, we show the impact of nonuniformity on the performance of this recent model and we exploit the structure of the model to improve its performance in practical applications where data is not necessarily uniform. In order to approach the performance of networks with uniformly distributed messages presented in theoretical studies, twin neurons are introduced. To assess the adapted model, twin neurons are used with realworld data to optimize power consumption of electronic circuits in practical testcases.
Download manuscript.
Bibtex@article{BogGriSegHei2016,
author = {Bartosz Boguslawski and Vincent Gripon and
Fabrice Seguin and Frédéric Heitzmann},
title = {Twin Neurons for Efficient RealWorld Data
Distribution in Networks of Neural Cliques.
Applications in Power Management in Electronic
circuits},
journal = {IEEE Transactions on Neural Networks and
Learning Systems},
year = {2016},
volume = {27},
number = {2},
pages = {375387},
}

We study various models of associative memories with sparse information, i.e. a pattern to be stored is a random string of 0s and 1s with about logN 1s, only. We compare different synaptic weights, architectures and retrieval mechanisms to shed light on the influence of the various parameters on the storage capacity.
Download manuscript.
Bibtex@article{GriHeuLöVer2016,
author = {Vincent Gripon and Judith Heusel and
Matthias Löwe and Franck Vermet},
title = {A Comparative Study of Sparse Associative
Memories},
journal = {Journal of Statistical Physics},
year = {2016},
volume = {164},
pages = {105129},
}

An emerging trend in visual information processing is toward incorporating some interesting properties of the ventral stream in order to account for some limitations of machine learning algorithms. Selective attention and cortical magnification are two such important phenomena that have been the subject of a large body of research in recent years. In this paper, we focus on designing a new model for visual acquisition that takes these important properties into account.
Download manuscript.
Bibtex@article{AboGriCop20169,
author = {Ala Aboudib and Vincent Gripon and Gilles
Coppin},
title = {A Biologically Inspired Framework for
Visual Information Processing and an Application on
Modeling BottomUp Visual Attention},
journal = {Cognitive Computation},
year = {2016},
pages = {120},
month = {September},
}

Thanks to their stateoftheart performance, deep neural networks are increasingly used for object recognition. To achieve the best results, they use millions of parameters to be trained. However, when targetting embedded applications the size of these models becomes problematic. As a consequence, their usage on smartphones or other resource limited devices is prohibited. In this paper we introduce a novel compression method for deep neural networks that is performed during the learning phase. It consists in adding an extra regularization term to the cost function of fullyconnected layers. We combine this method with Product Quantization (PQ) of the trained weights for higher savings in storage consumption. We evaluate our method on two data sets (MNIST and CIFAR10), on which we achieve significantly larger compression rates than stateoftheart methods.
Download manuscript.
Bibtex@article{SouGriRob20169,
author = {Guillaume Soulié and Vincent Gripon and
Maëlys Robert},
title = {Compression of Deep Neural Networks on the
Fly},
journal = {Lecture Notes in Computer Science},
year = {2016},
volume = {9887},
pages = {153170},
month = {September},
}

Finding correspondences between image features is a fundamental question in computer vision. Many models in literature have proposed to view this as a graph matching problem whose solution can be approximated using optimization principles. In this paper, we propose a different treatment of this problem from a neural network perspective. We present a new model for matching features inspired by the architecture of a recently introduced neural network. We show that by using popular neural network principles like maxpooling, kwinnerstakeall and iterative processing, we obtain a better accuracy at matching features in cluttered environments. The proposed solution is accompanied by an experimental evaluation and is compared to stateoftheart models.
Download manuscript.
Bibtex@article{AboGriCop20169,
author = {Ala Aboudib and Vincent Gripon and Gilles
Coppin},
title = {A Neural Network Model for Solving the
Feature Correspondence Problem},
journal = {Lecture Notes in Computer Science},
year = {2016},
volume = {9887},
pages = {439446},
month = {September},
}

Associative memories allow the retrieval of previously stored messages given a part of their content. In this paper, we are interested in associative memories based onpartite graphs that were recently introduced. These memories are almost optimal in terms of the amount of storage they require (efficiency) and allow retrieving messages with low complexity. We propose a generic im plementation model for the retrieval algorithm that can be readily mapped to an integrated circuit and study the retrieval performance when hardware components are affected by faults. We show using analytical and simulation results that these associative memories can be made resilient to circuit faults with a minor modification of the retrieval algorithm. In one example, the memory retains 88% of its efficiency when 1% of the storage cells are faulty, or 98% when 0.1% of the binary outputs of the retrieval algorithm are faulty. When considering storage faults, the fault tolerance exhibited by the proposed associative memory can be comparable tousing a capacityachieving error correction code for protecting the stored information.
Download manuscript.
Bibtex@article{LedGriRabGro2015,
author = {François LeducPrimeau and Vincent Gripon
and Michael Rabbat and Warren J. Gross},
title = {FaultTolerant Associative Memories Based
on cPartite Graphs},
journal = {IEEE Transactions on Signal Processing},
year = {2015},
volume = {64},
number = {4},
pages = {829841},
}

An extension to a recently introduced binary neural network is proposed in order to allow the learning of sparse messages, in large numbers and with high memory efficiency. This new network is justified both in biological and informational terms. The learning and retrieval rules are detailed and illustrated by various simulation results.
Download manuscript.
Bibtex@article{AliBerGriJia2014,
author = {Behrooz Kamary Aliabadi and Claude Berrou
and Vincent Gripon and Xiaoran Jiang},
title = {Storing sparse messages in networks of
neural cliques},
journal = {IEEE Transactions on Neural Networks and
Learning Systems},
year = {2014},
volume = {25},
pages = {980989},
}

Associative memories retrieve stored information given partial or erroneous input patterns. A new family of associative memories based on Sparse Clustered Networks (SCNs) has been recently introduced that can store many more messages than classical HopfieldNeural Networks (HNNs). In this paper, we propose fullyparallel hardware architectures of such memories for partial or erroneous inputs. The proposed architectures eliminate winnertakeall modules and thus reduce the hardware complexity by consuming 65% fewer FPGA lookup tables and increase the operating frequency by approximately 1.9 times compared to that of previous work. Furthermore, the scaling behaviour of the implemented architectures for various design choices are investigated. We explore the effect of varying design variables such as the number of clusters, network nodes, and erased symbols on the error performance and the hardware resources.
Download manuscript.
Bibtex@article{JarOniGriGro2014,
author = {Hooman Jarollahi and Naoya Onizawa and
Vincent Gripon and Warren J. Gross},
title = {Algorithm and Architecture of
FullyParallel Associative Memories Based on Sparse
Clustered Networks},
journal = {Journal of Signal Processing Systems},
year = {2014},
pages = {113},
}

H. Jarollahi, N. Onizawa, V. Gripon, N. Sakimura, T. Sugibayashi, T. Endoh, H. Ohno, T. Hanyu and W. J. Gross, "A NonVolatile Associative MemoryBased ContextDriven Search Engine Using 90 nm CMOS MTJHybrid LogicinMemory Architecture," in Journal on Emerging and Selected Topics in Circuits and Systems, Volume 4, pp. 460474, 2014.
This paper presents algorithm, architecture, and fabrication results of a nonvolatile contextdriven search engine that reduces energy consumption as well as computational delay compared to classical hardware and softwarebased approaches. The proposed architecture stores only associations between items from multiple search fields in the form of binary links, and merges repeated field items to reduce the memory requirements and ac cesses. The fabricated chip achievesmemory reduction and 89% energy saving compared to a classical fieldbased approach in hardware, based on contentaddressable memory (CAM). Furthermore, it achievesreduced number of clock cycles in performing search operations compared to the CAM, and five or ders of magnitude reduced number of clock cycles compared to a fabricated and measured ultra lowpower CPUbased counterpart running a classical search algorithm in software. The energy con sumption of the proposed architecture is on average three orders of magnitude smaller than that of a softwarebased approach. A magnetic tunnel junction (MTJ)based logicinmemory architec ture is presented that allows simple routing and eliminates leakage current in standby using 90 nm CMOS/MTJhybrid technologies.
Download manuscript.
Bibtex@article{JarOniGriSakSugEndOhnHanGro2014,
author = {Hooman Jarollahi and Naoya Onizawa and
Vincent Gripon and Noboru Sakimura and Tadahiko
Sugibayashi and Tetsuo Endoh and Hideo Ohno and
Takahiro Hanyu and Warren J. Gross},
title = {A NonVolatile Associative MemoryBased
ContextDriven Search Engine Using 90 nm CMOS
MTJHybrid LogicinMemory Architecture},
journal = {Journal on Emerging and Selected Topics
in Circuits and Systems},
year = {2014},
volume = {4},
pages = {460474},
}

Coded recurrent neural networks with three levels of sparsity are introduced. The first level is related to the size of messages, much smaller than the number of available neurons. The second one is provided by a particular coding rule, acting as a local constraint in the neural activity. The third one is a characteristic of the low final connection density of the network after the learning phase. Though the proposed network is very simple since it is based on binary neurons and binary connections, it is able to learn a large number of messages and recall them, even in presence of strong erasures.
Download manuscript.
Bibtex@article{GriBer20117,
author = {Vincent Gripon and Claude Berrou},
title = {Sparse neural networks with large learning
diversity},
journal = {IEEE Transactions on Neural Networks},
year = {2011},
volume = {22},
number = {7},
pages = {10871096},
month = {July},
}


You are the 1866816th visitor
