Academic
Publications
Online parts-based feature discovery using competitive activation neural networks

Online parts-based feature discovery using competitive activation neural networks,10.1109/IJCNN.2011.6033397,Lester Lehn Solbakken,Steffen Junge

Online parts-based feature discovery using competitive activation neural networks  
BibTex | RIS | RefWorks Download
The family of competitive activation models has recently attracted some interest. These models are a variation upon competitive neural networks where a local feedback process drives the competitive interaction rather than some form of lateral inhibition. However, this process can be viewed in terms of a generative model that reduces the generalized Kullback-Leibler divergence between the input distribution and the reconstruction distribution. From this insight we construct an online training method based on a stochastic gradient descent that reduces this measure while retaining the constraint of non-negativity inherent in the competitive neural network. We compare our results to non-negative matrix factorization (NMF), and show how the method results in a highly orthogonal, localized and parts-based representation of the data set, even when NMF does not, without the use of any explicit orthogonality or localization regularizers. Additionally, we show how the method leads to a basis better suited for discriminative tasks. I. INTRODUCTION
Conference: International Symposium on Neural Networks - ISNN , pp. 1466-1473, 2011
Cumulative Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.