Acknowledgments |
Natural Intelligence / Part I: |
Neural Networks in a Nutshell |
Characteristics of Neural Networks |
Comparing a Neural Network to a Digital Computer |
Building Blocks of Neural Networks |
The Anatomy of a Neurode |
The Network in Action |
Implementation: The Artificial Retina |
Neural Networks and Other System |
Neural Networks and Artificial Intelligence |
Neural Networks and Parallel Computers |
Do Neurodes Have Internal Memory? |
Relationship to Analog Computers |
Associative Memories / Part II: |
Features of Associative Memories |
Classes of Neural Network Associative Memories |
Using an Associative Memory |
Neural Network Models |
Crossbar Associative Memories |
Energy Surface Representation |
Matrix Representation of Crossbar Networks |
Feedback Competition Representation |
An Illustrative Example |
The Problems with Crossbar Networks |
Then Why Study the Crossbar? |
Adaptive Filter Associative Memories |
Introducing the Adaline |
Geometry of the Delta Rule |
Choosing the Learning Constant |
What Can the Adaline Do? |
Limitations of the Adaline |
Training the Madaline |
Higher-Order Networks |
The Polynomial Adaline |
Application: The Vectorcardiograph |
Competitive Filter Associative Memories |
A Self-Organizing Architecture |
Lateral Inhibition |
The Network in Operation |
The Geometry of the Network |
The Crust Thickens |
Training Techniques |
The Topology-Preserving Map |
Application: The Voice Typewriter |
Learning / Part III: |
Types of Learning |
Memory |
Learning and Memory in Neural Networks |
Training a Neural Network |
Hebbian Learning |
Neohebbian Learning |
Differential Hebbian Learning |
Classical, Conditioning |
Classical or Pavlovian Conditioning |
The Instar and Outstar |
Outstar Learning |
Outstar Inconsistencies |
Drive-Reinforcement Theory |
Learning Sequences of Patterns |
The Music Box Associative Memory |
Single-Neurode Systems |
The Outstar Avalanche |
Recognizing Sequences of Patterns |
Autonomous Learning |
Characteristics of Autonomous Learning Systems |
Recall by Association |
Seek and Ye Shall Find |
Dealing with Reality |
The Importance of Being Significant |
On with the New, On with the Old |
Categorically Speaking |
The Memory Shell Game |
Elementary, My Dear Watson |
An Ocean of Experience |
Autonomous Learning Redux |
A Classic System: The Perceptron |
Hierarchical Systems / Part IV: |
Linear Separability |
Kolmogorov's Theorem |
What Kolmogorov Didn't Say |
Application: The Neocognitron |
Backpropagation Networks |
Features of Backpropagation Systems |
Building a Backpropagation System |
The Backpropagation Process |
Limitations of Backpropagation Networks |
Variations of the Generalized Delta Rule |
Scaling Problems |
Biological Arguments against Backpropagation |
Applications of Backpropagation Systems |
Application: NETtalk |
Hybrid Networks |
The Counterpropagation Network |
Training Techniques and Problems |
The Size of the Middle Layer |
Using the Counterpropagation Network |
Adaptive Resonance Networks |
The Principle of Adaptive Resonance |
Operation of the ART 1 Network |
The Reset Subsystem |
The Gain Control Subsystem and the 2/3 Rule |
Troubles with ART 1 |
Art 2 |
Grandmother Nodes and ART |
The Limitations of ART Networks in General |
Neural Network Implementations / Part V: |
Software Simulations |
Neurocomputers |
Networks in Hardware |
Optical Neural Networks |
Neural Network |
An Expert Mortgage Insurance Underwriter |
A Process Controller That the Freeway |
A Robotic Arm |
Sonar Signal Processing |
A Look Ahead |
Implementations Development |
Weird Science |
Neural Network Theory |
Applications |
A Final Word |
Glossary |
Index |
Acknowledgments |
Natural Intelligence / Part I: |
Neural Networks in a Nutshell |