Neocognitron: Difference between revisions
m Journal cites, added 1 PMID, added 1 PMC using AWB (12137) |
m typo |
||
| Line 2: | Line 2: | ||
The '''neocognitron''' is a hierarchical, multilayered [[artificial neural network]] proposed by Kunihiko Fukushima in the 1980s. It has been used for [[Handwriting recognition|handwritten character recognition]] and other [[pattern recognition]] tasks, and served as the inspiration for [[convolutional neural network]]s.<ref>{{cite journal |first1=Yann |last1=LeCun |first2=Yoshua |last2=Bengio |first3=Geoffrey |last3=Hinton |title=Deep learning |journal=Nature |volume=521 |year=2015 |pages=436–444 |doi=10.1038/nature14539 |pmid=26017442}}</ref> |
The '''neocognitron''' is a hierarchical, multilayered [[artificial neural network]] proposed by Kunihiko Fukushima in the 1980s. It has been used for [[Handwriting recognition|handwritten character recognition]] and other [[pattern recognition]] tasks, and served as the inspiration for [[convolutional neural network]]s.<ref>{{cite journal |first1=Yann |last1=LeCun |first2=Yoshua |last2=Bengio |first3=Geoffrey |last3=Hinton |title=Deep learning |journal=Nature |volume=521 |year=2015 |pages=436–444 |doi=10.1038/nature14539 |pmid=26017442}}</ref> |
||
The neocognitron was inspired by the model proposed by [[Hubel]] & [[Torsten Wiesel|Wiesel]] in 1959. They found two types of cells in the visual primary cortex called ''[[simple cell]]'' and ''[[complex cell]]'', and also proposed a cascading model of these two types of cells for use in pattern |
The neocognitron was inspired by the model proposed by [[Hubel]] & [[Torsten Wiesel|Wiesel]] in 1959. They found two types of cells in the visual primary cortex called ''[[simple cell]]'' and ''[[complex cell]]'', and also proposed a cascading model of these two types of cells for use in pattern recognition tasks.<ref> |
||
{{cite book |
{{cite book |
||
|title = Brain and visual perception: the story of a 25-year collaboration |
|title = Brain and visual perception: the story of a 25-year collaboration |
||
Revision as of 22:33, 16 January 2017
The neocognitron is a hierarchical, multilayered artificial neural network proposed by Kunihiko Fukushima in the 1980s. It has been used for handwritten character recognition and other pattern recognition tasks, and served as the inspiration for convolutional neural networks.[1]
The neocognitron was inspired by the model proposed by Hubel & Wiesel in 1959. They found two types of cells in the visual primary cortex called simple cell and complex cell, and also proposed a cascading model of these two types of cells for use in pattern recognition tasks.[2][3]
The neocognitron is a natural extension of these cascading models. The neocognitron consists of multiple types of cells, the most important of which are called S-cells and C-cells.[4] The local features are extracted by S-cells, and these features' deformation, such as local shifts, are tolerated by C-cells. Local features in the input are integrated gradually and classified in the higher layers.[5] The idea of local feature integration is found in several other models, such as the LeNet model and the SIFT model.
There are various kinds of neocognitron.[6] For example, some types of neocognitron can detect multiple patterns in the same input by using backward signals to achieve selective attention.[7]
See also
- Self-organizing map
- Artificial neural network
- Pattern recognition
- Unsupervised learning
- Deep learning
- Receptive field
Notes
- ^ LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey (2015). "Deep learning". Nature. 521: 436–444. doi:10.1038/nature14539. PMID 26017442.
- ^ David H. Hubel and Torsten N. Wiesel (2005). Brain and visual perception: the story of a 25-year collaboration. Oxford University Press US. p. 106. ISBN 978-0-19-517618-6.
- ^ Hubel, DH; Wiesel, TN (October 1959). "Receptive fields of single neurones in the cat's striate cortex". J. Physiol. (Lond.). 148: 574–91. doi:10.1113/jphysiol.1959.sp006308. PMC 1363130. PMID 14403679.
- ^ Fukushima 1987, p. 83.
- ^ Fukushima 1987, p. 84.
- ^ Fukushima 2007
- ^ Fukushima 1987, pp.81, 85
References
- Fukushima, Neocognitron (1980). "A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position". Biological Cybernetics. 36 (4): 93–202.
- Fukushima, K.; Miyake, S.; Ito, T. (1983). "Neocognitron: a neural network model for a mechanism of visual pattern recognition". IEEE Transactions on Systems, Man, and Cybernetics. SMC-13 (3): 826–834.
- K. Fukushima. "A hierarchical neural network model for selective attention." In Eckmiller, R. & Von der Malsburg, C. eds. Neural computers, Springer-Verlag. pp. 81–90. 1987.
- Fukushima, K. (2007). "Neocognitron". Scholarpedia. 2 (1): 1717. doi:10.4249/scholarpedia.1717.
{{cite journal}}: CS1 maint: unflagged free DOI (link) - Hubel, D.H.; Wiesel, T.N. (1959). "Receptive fields of single noreones in the cat's striate cortex". J Physiol. 148 (3): 574–591. doi:10.1113/jphysiol.1959.sp006308. PMC 1363130. PMID 14403679.
External links
- Neocognitron on Scholarpedia
- NeoCognitron by Ing. Gabriel Minarik - application (C#) and video
- Neocognitron resources at Visiome Platform - includes MATLAB environment
- Beholder - a Neocognitron simulator
- Neocognitron on Learn artificial neural networks
 | This artificial intelligence-related article is a stub. You can help Wikipedia by expanding it. |