||It has been suggested that Madaline be merged into this article. (Discuss) Proposed since May 2014.|
ADALINE (Adaptive Linear Neuron or later Adaptive Linear Element) is an early single-layer artificial neural network and the name of the physical device that implemented this network. The network uses memistors. It was developed by Professor Bernard Widrow and his graduate student Ted Hoff at Stanford University in 1960. It is based on the McCulloch–Pitts neuron. It consists of a weight, a bias and a summation function.
The difference between Adaline and the standard (McCulloch–Pitts) perceptron is that in the learning phase the weights are adjusted according to the weighted sum of the inputs (the net). In the standard perceptron, the net is passed to the activation (transfer) function and the function's output is used for adjusting the weights.
There also exists an extension known as Madaline.
Adaline is a multiple layer neural network with multiple nodes where each node accepts multiple inputs and generates one output. Given the following variables:as
- x is the input vector
- w is the weight vector
- n is the number of inputs
- some constant
- y is the output of the model
then we find that the output is . If we further assume that
then the output further reduces to the dot product of x and w:
Let us assume:
- is the learning rate (some positive constant)
- is the output of the model
- is the target (desired) output
- Talking Nets: An Oral History of Neural Networks.
- Youtube: widrowlms: Science in Action
- 1960: An adaptive "ADALINE" neuron using chemical "memistors"
- Youtube: widrowlms: The LMS algorithm and ADALINE. Part I - The LMS algorithm
- Youtube: widrowlms: The LMS algorithm and ADALINE. Part II - ADALINE and memistor ADALINE
- "Adaline (Adaptive Linear)" (PDF). CS 4793: Introduction to Artificial Neural Networks. Department of Computer Science, University of Texas at San Antonio.
- Avi Pfeffer. "CS181 Lecture 5 — Perceptrons" (PDF). Harvard University.
- "Delta Learning Rule: ADALINE". Artificial Neural Networks. Universidad Politécnica de Madrid.