CaltechAUTHORS
  A Caltech Library Service

Contrastive learning and neural oscillations

Baldi, Pierre and Pineda, Fernando (1991) Contrastive learning and neural oscillations. Neural Computation, 3 (4). pp. 526-545. ISSN 0899-7667. http://resolver.caltech.edu/CaltechAUTHORS:BALnc91a

[img]
Preview
PDF - Published Version
See Usage Policy.

998Kb

Use this Persistent URL to link to this item: http://resolver.caltech.edu/CaltechAUTHORS:BALnc91a

Abstract

The concept of Contrastive Learning (CL) is developed as a family of possible learning algorithms for neural networks. CL is an extension of Deterministic Boltzmann Machines to more general dynamical systems. During learning, the network oscillates between two phases. One phase has a teacher signal and one phase has no teacher signal. The weights are updated using a learning rule that corresponds to gradient descent on a contrast function that measures the discrepancy between the free network and the network with a teacher signal. The CL approach provides a general unified framework for developing new learning algorithms. It also shows that many different types of clamping and teacher signals are possible. Several examples are given and an analysis of the landscape of the contrast function is proposed with some relevant predictions for the CL curves. An approach that may be suitable for collective analog implementations is described. Simulation results and possible extensions are briefly discussed together with a new conjecture regarding the function of certain oscillations in the brain. In the appendix, we also examine two extensions of contrastive learning to time-dependent trajectories.


Item Type:Article
Related URLs:
URLURL TypeDescription
http://dx.doi.org/10.1162/neco.1991.3.4.526DOIUNSPECIFIED
http://www.mitpressjournals.org/doi/abs/10.1162/neco.1991.3.4.526PublisherUNSPECIFIED
Additional Information:© 1991 MIT Press. Received 6 February 1991; accepted 14 June 1991. We would like to thank the referee for several useful comments. This work is supported by ONR Contract NAS7-100/918 and a McDonnell-Pew grant to P.B., and AFOSR Grant ISSA-91-0017 to F.P.
Funders:
Funding AgencyGrant Number
Office of Naval ResearchNAS7-100/918
McDonnell-PewUNSPECIFIED
Air Force Office of Scientific ResearchISSA-91-0017
Record Number:CaltechAUTHORS:BALnc91a
Persistent URL:http://resolver.caltech.edu/CaltechAUTHORS:BALnc91a
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:13269
Collection:CaltechAUTHORS
Deposited By: Marie Noren
Deposited On:05 Feb 2009 20:28
Last Modified:26 Dec 2012 10:47

Repository Staff Only: item control page