CaltechAUTHORS
  A Caltech Library Service

Hints

Abu-Mostafa, Yaser S. (1995) Hints. Neural Computation, 7 (4). pp. 639-671. ISSN 0899-7667. doi:10.1162/neco.1995.7.4.639. https://resolver.caltech.edu/CaltechAUTHORS:ABUnc95

[img]
Preview
PDF - Published Version
See Usage Policy.

1MB

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:ABUnc95

Abstract

The systematic use of hints in the learning-from-examples paradigm is the subject of this review. Hints are the properties of the target function that are known to us independently of the training examples. The use of hints is tantamount to combining rules and data in learning, and is compatible with different learning models, optimization techniques, and regularization techniques. The hints are represented to the learning process by virtual examples, and the training examples of the target function are treated on equal footing with the rest of the hints. A balance is achieved between the information provided by the different hints through the choice of objective functions and learning schedules. The Adaptive Minimization algorithm achieves this balance by relating the performance on each hint to the overall performance. The application of hints in forecasting the very noisy foreign-exchange markets is illustrated. On the theoretical side, the information value of hints is contrasted to the complexity value and related to the VC dimension.


Item Type:Article
Related URLs:
URLURL TypeDescription
http://dx.doi.org/10.1162/neco.1995.7.4.639DOIUNSPECIFIED
Additional Information:© 1995 The MIT Press. Received May 10, 1994; accepted December 20, 1994. I wish to acknowledge the members of the Learning Systems Group at Caltech, Mr. Eric Bax, Ms. Zehra Cataltepe, Mr. Joseph Sill, and Ms. Xubo Song, for many valuable discussions. In particular, Ms. Cataltepe was very helpful throughout this work. Dedicated to the memory of Said Abu-Mostafa.
Issue or Number:4
DOI:10.1162/neco.1995.7.4.639
Record Number:CaltechAUTHORS:ABUnc95
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:ABUnc95
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:11998
Collection:CaltechAUTHORS
Deposited By: Archive Administrator
Deposited On:16 Oct 2008 22:43
Last Modified:08 Nov 2021 22:23

Repository Staff Only: item control page