A Caltech Library Service

An Information Theoretic Approach to Modeling Neural Network Expert Systems

Goodman, Rodney M. and Miller, John W. and Smyth, Padhraic (1989) An Information Theoretic Approach to Modeling Neural Network Expert Systems. In: IEEE/CAM Information Theory Workshop at Cornell. IEEE , Piscataway, NJ, 8_2.

[img] PDF - Published Version
See Usage Policy.


Use this Persistent URL to link to this item:


In this paper we propose several novel techniques for mapping rule bases, such as are used in rule based expert systems, onto neural network architectures. Our objective in doing this is to achieve a system capable of incremental learning, and distributed probabilistic inference. Such a system would be capable of performing inference many orders of magnitude faster than current serial rule based expert systems, and hence be capable of true real time operation. In addition, the rule based formalism gives the system an explicit knowledge representation, unlike current neural models. We propose an information-theoretic approach to this problem, which really has two aspects: firstly learning the model and, secondly, performing inference using this model. We will show a clear pathway to implementing an expert system starting from raw data, via a learned rule-based model, to a neural network that performs distributed inference.

Item Type:Book Section
Related URLs:
URLURL TypeDescription
Additional Information:© 1989 IEEE.
Record Number:CaltechAUTHORS:20170711-165746284
Persistent URL:
Official Citation:R. M. Goodman, J. W. Miller and P. Smyth, "An Information Theoretic Approach to Modeling Neural Network Expert Systems," IEEE/CAM Information Theory Workshop at Cornell, 1989, pp. 8_2-8_2. doi: 10.1109/ITW.1989.761436
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:78972
Deposited On:12 Jul 2017 00:09
Last Modified:15 Nov 2021 17:44

Repository Staff Only: item control page