Neuromorphic engineering

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search

Neuromorphic engineering, also known as neuromorphic computing,[1][2][3] is the use of very-large-scale integration (VLSI) systems containing electronic analog circuits to mimic neuro-biological architectures present in the nervous system. A neuromorphic computer/chip is any device that uses physical artificial neurons (made from silicon) to do computations.[4][5] In recent times, the term neuromorphic has been used to describe analog, digital, mixed-mode analog/digital VLSI, and software systems that implement models of neural systems (for perception, motor control, or multisensory integration). The implementation of neuromorphic computing on the hardware level can be realized by oxide-based memristors,[6] spintronic memories, threshold switches, and transistors.[7][5] Training software-based neuromorphic systems of spiking neural networks can be achieved using error backpropagation, e.g., using Python based frameworks such as snnTorch,[8] or using canonical learning rules from the biological learning literature, e.g., using BindsNet.[9]

A key aspect of neuromorphic engineering is understanding how the morphology of individual neurons, circuits, applications, and overall architectures creates desirable computations, affects how information is represented, influences robustness to damage, incorporates learning and development, adapts to local change (plasticity), and facilitates evolutionary change.

Neuromorphic engineering is an interdisciplinary subject that takes inspiration from biology, physics, mathematics, computer science, and electronic engineering[5] to design artificial neural systems, such as vision systems, head-eye systems, auditory processors, and autonomous robots, whose physical architecture and design principles are based on those of biological nervous systems.[10] It was developed by Carver Mead[11] in the late 1980s.

Neurological inspiration[edit]

Neuromorphic engineering is set apart by the inspiration it takes from what we know about the structure and operations of the brain. Neuromorphic engineering translates what we know about the brain's function into computer systems. Work has mostly focused on replicating the analog nature of biological computation and the role of neurons in cognition.

The biological processes of neurons and their synapses are dauntingly complex, and thus very difficult to artificially simulate. A key feature of biological brains is that all of the processing in neurons use analog chemical signals. This makes it hard to replicate brains in computers because the current generation of computers is completely digital. However, the characteristics of these parts can be abstracted into mathematical functions that closely capture the essence of the neuron's operations.

The goal of neuromorphic computing is not to perfectly mimic the brain and all of its functions, but instead to extract what is known of its structure and operations to be used in a practical computing system. No neuromorphic system will claim nor attempt to reproduce every element of neurons and synapses, but all adhere to the idea that computation is highly distributed throughout a series of small computing elements analogous to a neuron. While this sentiment is standard, researchers chase this goal with different methods.[12]

Examples[edit]

As early as 2006, researchers at Georgia Tech published a field programmable neural array.[13] This chip was the first in a line of increasingly complex arrays of floating gate transistors that allowed programmability of charge on the gates of MOSFETs to model the channel-ion characteristics of neurons in the brain and was one of the first cases of a silicon programmable array of neurons.

In November 2011, a group of MIT researchers created a computer chip that mimics the analog, ion-based communication in a synapse between two neurons using 400 transistors and standard CMOS manufacturing techniques.[14][15]

In June 2012, spintronic researchers at Purdue University presented a paper on the design of a neuromorphic chip using lateral spin valves and memristors. They argue that the architecture works similarly to neurons and can therefore be used to test methods of reproducing the brain's processing. In addition, these chips are significantly more energy-efficient than conventional ones.[16]

Research at HP Labs on Mott memristors has shown that while they can be non-volatile, the volatile behavior exhibited at temperatures significantly below the phase transition temperature can be exploited to fabricate a neuristor,[17] a biologically-inspired device that mimics behavior found in neurons.[17] In September 2013, they presented models and simulations that show how the spiking behavior of these neuristors can be used to form the components required for a Turing machine.[18]

Neurogrid, built by Brains in Silicon at Stanford University,[19] is an example of hardware designed using neuromorphic engineering principles. The circuit board is composed of 16 custom-designed chips, referred to as NeuroCores. Each NeuroCore's analog circuitry is designed to emulate neural elements for 65536 neurons, maximizing energy efficiency. The emulated neurons are connected using digital circuitry designed to maximize spiking throughput.[20][21]

A research project with implications for neuromorphic engineering is the Human Brain Project that is attempting to simulate a complete human brain in a supercomputer using biological data. It is made up of a group of researchers in neuroscience, medicine, and computing.[22] Henry Markram, the project's co-director, has stated that the project proposes to establish a foundation to explore and understand the brain and its diseases, and to use that knowledge to build new computing technologies. The three primary goals of the project are to better understand how the pieces of the brain fit and work together, to understand how to objectively diagnose and treat brain diseases, and to use the understanding of the human brain to develop neuromorphic computers. That the simulation of a complete human brain will require a supercomputer a thousand times more powerful than today's encourages the current focus on neuromorphic computers.[23] $1.3 billion has been allocated to the project by The European Commission.[24]

Other research with implications for neuromorphic engineering involve the BRAIN Initiative[25] and the TrueNorth chip from IBM.[26] Neuromorphic devices have also been demonstrated using nanocrystals, nanowires, and conducting polymers.[27] There also is development of a memristive device for quantum neuromorphic architectures.[28]

Intel unveiled its neuromorphic research chip, called “Loihi”, in October 2017. The chip uses an asynchronous spiking neural network (SNN) to implement adaptive self-modifying event-driven fine-grained parallel computations used to implement learning and inference with high efficiency.[29][30]

IMEC, a Belgium-based nanoelectronics research center, demonstrated the world's first self-learning neuromorphic chip. The brain-inspired chip, based on OxRAM technology, has the capability of self-learning and has been demonstrated to have the ability to compose music.[31] IMEC released the 30-second tune composed by the prototype. The chip was sequentially loaded with songs in the same time signature and style. The songs were old Belgian and French flute minuets, from which the chip learned the rules at play and then applied them.[32]

The Blue Brain Project, led by Henry Markram, aims to build biologically detailed digital reconstructions and simulations of the mouse brain. The Blue Brain Project has created in silico models of rodent brains, while attempting to replicate as many details about its biology as possible. The supercomputer-based simulations offer new perspectives on understanding the structure and functions of the brain.

The European Union funded a series of projects at the University of Heidelberg, which led to the development of BrainScaleS (brain-inspired multiscale computation in neuromorphic hybrid systems), a hybrid analog neuromorphic supercomputer located at Heidelberg University, Germany. It was developed as part of the Human Brain Project neuromorphic computing platform and is the complement to the SpiNNaker supercomputer (which is based on digital technology). The architecture used in BrainScaleS mimics biological neurons and their connections on a physical level; additionally, since the components are made of silicon, these model neurons operate on average 864 times (24 hours of real time is 100 seconds in the machine simulation) that of their biological counterparts.[33]

Neuromorphic sensors[edit]

The concept of neuromorphic systems can be extended to sensors (not just to computation). An example of this applied to detecting light is the retinomorphic sensor or, when employed in an array, the event camera.

Ethical considerations[edit]

While the interdisciplinary concept of neuromorphic engineering is relatively new, many of the same ethical considerations apply to neuromorphic systems as apply to human-like machines and artificial intelligence in general. However, the fact that neuromorphic systems are designed to mimic a human brain gives rise to unique ethical questions surrounding their usage.

However, the practical debate is that neuromorphic hardware as well as artificial "neural networks" are immensely simplified models of how the brain operates or processes information at a much lower complexity in terms of size and functional technology and a much more regular structure in terms of connectivity. Comparing neuromorphic chips to the brain is a very crude comparison similar to comparing a plane to a bird just because they both have wings and a tail. The fact is that neural cognitive systems are many orders of magnitude more energy- and compute-efficient than current state-of-the-art AI and neuromorphic engineering is an attempt to narrow this gap by inspiring from the brain's mechanism just like many engineering designs have bio-inspired features.

Democratic concerns[edit]

Significant ethical limitations may be placed on neuromorphic engineering due to public perception.[34] Special Eurobarometer 382: Public Attitudes Towards Robots, a survey conducted by the European Commission, found that 60% of European Union citizens wanted a ban of robots in the care of children, the elderly, or the disabled. Furthermore, 34% were in favor of a ban on robots in education, 27% in healthcare, and 20% in leisure. The European Commission classifies these areas as notably “human.” The report cites increased public concern with robots that are able to mimic or replicate human functions. Neuromorphic engineering, by definition, is designed to replicate the function of the human brain.[35]

The democratic concerns surrounding neuromorphic engineering are likely to become even more profound in the future. The European Commission found that EU citizens between the ages of 15 and 24 are more likely to think of robots as human-like (as opposed to instrument-like) than EU citizens over the age of 55. When presented an image of a robot that had been defined as human-like, 75% of EU citizens aged 15–24 said it corresponded with the idea they had of robots while only 57% of EU citizens over the age of 55 responded the same way. The human-like nature of neuromorphic systems, therefore, could place them in the categories of robots many EU citizens would like to see banned in the future.[35]

Personhood[edit]

As neuromorphic systems have become increasingly advanced, some scholars[who?] have advocated for granting personhood rights to these systems. If the brain is what grants humans their personhood, to what extent does a neuromorphic system have to mimic the human brain to be granted personhood rights? Critics of technology development in the Human Brain Project, which aims to advance brain-inspired computing, have argued that advancement in neuromorphic computing could lead to machine consciousness or personhood.[36] If these systems are to be treated as people, critics argue, then many tasks humans perform using neuromorphic systems, including the act of termination of neuromorphic systems, may be morally impermissible as these acts would violate the autonomy of the neuromorphic systems.[37]

Dual use (military applications)[edit]

The Joint Artificial Intelligence Center, a branch of the U.S. military, is a center dedicated to the procurement and implementation of AI software and neuromorphic hardware for combat use. Specific applications include smart headsets/goggles and robots. JAIC intends to rely heavily on neuromorphic technology to connect "every fighter every shooter" within a network of neuromorphic-enabled units.

Legal considerations[edit]

Skeptics have argued that there is no way to apply the electronic personhood, the concept of personhood that would apply to neuromorphic technology, legally. In a letter signed by 285 experts in law, robotics, medicine, and ethics opposing a European Commission proposal to recognize “smart robots” as legal persons, the authors write, “A legal status for a robot can’t derive from the Natural Person model, since the robot would then hold human rights, such as the right to dignity, the right to its integrity, the right to remuneration or the right to citizenship, thus directly confronting the Human rights. This would be in contradiction with the Charter of Fundamental Rights of the European Union and the Convention for the Protection of Human Rights and Fundamental Freedoms.”[38]

Ownership and property rights[edit]

There is significant legal debate around property rights and artificial intelligence. In Acohs Pty Ltd v. Ucorp Pty Ltd, Justice Christopher Jessup of the Federal Court of Australia found that the source code for Material Safety Data Sheets could not be copyrighted as it was generated by a software interface rather than a human author.[39] The same question may apply to neuromorphic systems: if a neuromorphic system successfully mimics a human brain and produces a piece of original work, who, if anyone, should be able to claim ownership of the work?[40]

Neuromemristive systems[edit]

Neuromemristive systems are a subclass of neuromorphic computing systems that focus on the use of memristors to implement neuroplasticity. While neuromorphic engineering focuses on mimicking biological behavior, neuromemristive systems focus on abstraction.[41] For example, a neuromemristive system may replace the details of a cortical microcircuit's behavior with an abstract neural network model.[42]

There exist several neuron inspired threshold logic functions[6] implemented with memristors that have applications in high level pattern recognition applications. Some of the applications reported recently include speech recognition,[43] face recognition[44] and object recognition.[45] They also find applications in replacing conventional digital logic gates.[46][47]

For ideal passive memristive circuits there is an exact equation (Caravelli-Traversa-Di Ventra equation) for the internal memory of the circuit:[48]

as a function of the properties of the physical memristive network and the external sources. In the equation above, is the "forgetting" time scale constant, and is the ratio of off and on values of the limit resistances of the memristors, is the vector of the sources of the circuit and is a projector on the fundamental loops of the circuit. The constant has the dimension of a voltage and is associated to the properties of the memristor; its physical origin is the charge mobility in the conductor. The diagonal matrix and vector and respectively, are instead the internal value of the memristors, with values between 0 and 1. This equation thus requires adding extra constraints on the memory values in order to be reliable.

See also[edit]

References[edit]

  1. ^ Monroe, D. (2014). "Neuromorphic computing gets ready for the (really) big time". Communications of the ACM. 57 (6): 13–15. doi:10.1145/2601069. S2CID 20051102.
  2. ^ Zhao, W. S.; Agnus, G.; Derycke, V.; Filoramo, A.; Bourgoin, J. -P.; Gamrat, C. (2010). "Nanotube devices based crossbar architecture: Toward neuromorphic computing". Nanotechnology. 21 (17): 175202. Bibcode:2010Nanot..21q5202Z. doi:10.1088/0957-4484/21/17/175202. PMID 20368686.
  3. ^ The Human Brain Project SP 9: Neuromorphic Computing Platform on YouTube
  4. ^ Mead, Carver (1990). "Neuromorphic electronic systems" (PDF). Proceedings of the IEEE. 78 (10): 1629–1636. doi:10.1109/5.58356.
  5. ^ a b c "Neuromorphic Circuits With Neural Modulation Enhancing the Information Content of Neural Signaling | International Conference on Neuromorphic Systems 2020". doi:10.1145/3407197.3407204. S2CID 220794387. {{cite journal}}: Cite journal requires |journal= (help)
  6. ^ a b Maan, A. K.; Jayadevi, D. A.; James, A. P. (January 1, 2016). "A Survey of Memristive Threshold Logic Circuits". IEEE Transactions on Neural Networks and Learning Systems. PP (99): 1734–1746. arXiv:1604.07121. Bibcode:2016arXiv160407121M. doi:10.1109/TNNLS.2016.2547842. ISSN 2162-237X. PMID 27164608. S2CID 1798273.
  7. ^ Zhou, You; Ramanathan, S. (August 1, 2015). "Mott Memory and Neuromorphic Devices". Proceedings of the IEEE. 103 (8): 1289–1310. doi:10.1109/JPROC.2015.2431914. ISSN 0018-9219. S2CID 11347598.
  8. ^ Eshraghian, Jason K.; Ward, Max; Neftci, Emre; Wang, Xinxin; Lenz, Gregor; Dwivedi, Girish; Bennamoun, Mohammed; Jeong, Doo Seok; Lu, Wei D. (October 1, 2021). "Training Spiking Neural Networks Using Lessons from Deep Learning". arXiv:2109.12894. {{cite journal}}: Cite journal requires |journal= (help)
  9. ^ "Hananel-Hazan/bindsnet: Simulation of spiking neural networks (SNNs) using PyTorch". March 31, 2020.
  10. ^ Boddhu, S. K.; Gallagher, J. C. (2012). "Qualitative Functional Decomposition Analysis of Evolved Neuromorphic Flight Controllers". Applied Computational Intelligence and Soft Computing. 2012: 1–21. doi:10.1155/2012/705483.
  11. ^ Mead, Carver. "carver mead website". carvermead.
  12. ^ Furber, Steve (2016). "Large-scale neuromorphic computing systems". Journal of Neural Engineering. 13 (5): 1–15. Bibcode:2016JNEng..13e1001F. doi:10.1088/1741-2560/13/5/051001. PMID 27529195.
  13. ^ Farquhar, Ethan; Hasler, Paul. (May 2006). A field programmable neural array. IEEE International Symposium on Circuits and Systems. pp. 4114–4117. doi:10.1109/ISCAS.2006.1693534. ISBN 978-0-7803-9389-9. S2CID 206966013.
  14. ^ "MIT creates "brain chip"". Retrieved December 4, 2012.
  15. ^ Poon, Chi-Sang; Zhou, Kuan (2011). "Neuromorphic silicon neurons and large-scale neural networks: challenges and opportunities". Frontiers in Neuroscience. 5: 108. doi:10.3389/fnins.2011.00108. PMC 3181466. PMID 21991244.
  16. ^ Sharad, Mrigank; Augustine, Charles; Panagopoulos, Georgios; Roy, Kaushik (2012). "Proposal For Neuromorphic Hardware Using Spin Devices". arXiv:1206.3227 [cond-mat.dis-nn].
  17. ^ a b Pickett, M. D.; Medeiros-Ribeiro, G.; Williams, R. S. (2012). "A scalable neuristor built with Mott memristors". Nature Materials. 12 (2): 114–7. Bibcode:2013NatMa..12..114P. doi:10.1038/nmat3510. PMID 23241533. S2CID 16271627.
  18. ^ Matthew D Pickett & R Stanley Williams (September 2013). "Phase transitions enable computational universality in neuristor-based cellular automata". Nanotechnology. IOP Publishing Ltd. 24 (38). 384002. Bibcode:2013Nanot..24L4002P. doi:10.1088/0957-4484/24/38/384002. PMID 23999059.
  19. ^ Boahen, Kwabena (April 24, 2014). "Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations". Proceedings of the IEEE. 102 (5): 699–716. doi:10.1109/JPROC.2014.2313565. S2CID 17176371.
  20. ^ Waldrop, M. Mitchell (2013). "Neuroelectronics: Smart connections". Nature. 503 (7474): 22–4. Bibcode:2013Natur.503...22W. doi:10.1038/503022a. PMID 24201264.
  21. ^ Benjamin, Ben Varkey; Peiran Gao; McQuinn, Emmett; Choudhary, Swadesh; Chandrasekaran, Anand R.; Bussat, Jean-Marie; Alvarez-Icaza, Rodrigo; Arthur, John V.; Merolla, Paul A.; Boahen, Kwabena (2014). "Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations". Proceedings of the IEEE. 102 (5): 699–716. doi:10.1109/JPROC.2014.2313565. S2CID 17176371.
  22. ^ "Involved Organizations". Archived from the original on March 2, 2013. Retrieved February 22, 2013.
  23. ^ "Human Brain Project". Retrieved February 22, 2013.
  24. ^ "The Human Brain Project and Recruiting More Cyberwarriors". January 29, 2013. Retrieved February 22, 2013.
  25. ^ Neuromorphic computing: The machine of a new soul, The Economist, 2013-08-03
  26. ^ Modha, Dharmendra (August 2014). "A million spiking-neuron integrated circuit with a scalable communication network and interface". Science. 345 (6197): 668–673. Bibcode:2014Sci...345..668M. doi:10.1126/science.1254642. PMID 25104385. S2CID 12706847.
  27. ^ Fairfield, Jessamyn (March 1, 2017). "Smarter Machines" (PDF).
  28. ^ Spagnolo, Michele; Morris, Joshua; Piacentini, Simone; Antesberger, Michael; Massa, Francesco; Crespi, Andrea; Ceccarelli, Francesco; Osellame, Roberto; Walther, Philip (April 2022). "Experimental photonic quantum memristor". Nature Photonics. 16 (4): 318–323. doi:10.1038/s41566-022-00973-5. ISSN 1749-4893.
    News article: "Erster "Quanten-Memristor" soll KI und Quantencomputer verbinden". DER STANDARD (in Austrian German). Retrieved April 28, 2022.
    Lay summary report: "Artificial neurons go quantum with photonic circuits". University of Vienna. Retrieved April 19, 2022.
  29. ^ Davies, Mike; et al. (January 16, 2018). "Loihi: A Neuromorphic Manycore Processor with On-Chip Learning". IEEE Micro. 38 (1): 82–99. doi:10.1109/MM.2018.112130359. S2CID 3608458.
  30. ^ Morris, John. "Why Intel built a neuromorphic chip". ZDNet. Retrieved August 17, 2018.
  31. ^ "Imec demonstrates self-learning neuromorphic chip that composes music". IMEC International. Retrieved October 1, 2019.
  32. ^ Bourzac, Katherine (May 23, 2017). "A Neuromorphic Chip That Makes Music". IEEE Spectrum. Retrieved October 1, 2019.{{cite web}}: CS1 maint: url-status (link)
  33. ^ "Beyond von Neumann, Neuromorphic Computing Steadily Advances". HPCwire. March 21, 2016. Retrieved October 8, 2021.
  34. ^ 2015 Study Panel (September 2016). Artificial Intelligence and Life in 2030 (PDF). One Hundred Year Study on Artificial Intelligence (AI100) (Report). Stanford University.
  35. ^ a b European Commission (September 2012). "Special Eurobarometer 382: Public Attitudes Towards Robots" (PDF). European Commission.
  36. ^ Aicardi, Christine (September 2018). "Accompanying technology development in the Human Brain Project: From foresight to ethics management". Futures. 102: 114–124. doi:10.1016/j.futures.2018.01.005.
  37. ^ Lim, Daniel (June 1, 2014). "Brain simulation and personhood: a concern with the Human Brain Project". Ethics and Information Technology. 16 (2): 77–89. doi:10.1007/s10676-013-9330-5. ISSN 1572-8439. S2CID 17415814.
  38. ^ "Robotics Openletter | Open letter to the European Commission" (in French). Retrieved May 10, 2019.
  39. ^ Lavan. "Copyright in source code and digital products". Lavan. Retrieved May 10, 2019.
  40. ^ Eshraghian, Jason K. (March 9, 2020). "Human Ownership of Artificial Creativity". Nature Machine Intelligence. 2: 157–160. doi:10.1038/s42256-020-0161-x.
  41. ^ "002.08 N.I.C.E. Workshop 2014: Towards Intelligent Computing with Neuromemristive Circuits and Systems - Feb. 2014". digitalops.sandia.gov. Retrieved August 26, 2019.
  42. ^ C. Merkel and D. Kudithipudi, "Neuromemristive extreme learning machines for pattern classification," ISVLSI, 2014.
  43. ^ Maan, A.K.; James, A.P.; Dimitrijev, S. (2015). "Memristor pattern recogniser: isolated speech word recognition". Electronics Letters. 51 (17): 1370–1372. Bibcode:2015ElL....51.1370M. doi:10.1049/el.2015.1428. hdl:10072/140989. S2CID 61454815.
  44. ^ Maan, Akshay Kumar; Kumar, Dinesh S.; James, Alex Pappachen (January 1, 2014). "Memristive Threshold Logic Face Recognition". Procedia Computer Science. 5th Annual International Conference on Biologically Inspired Cognitive Architectures, 2014 BICA. 41: 98–103. doi:10.1016/j.procs.2014.11.090.
  45. ^ Maan, A.K.; Kumar, D.S.; Sugathan, S.; James, A.P. (October 1, 2015). "Memristive Threshold Logic Circuit Design of Fast Moving Object Detection". IEEE Transactions on Very Large Scale Integration (VLSI) Systems. 23 (10): 2337–2341. arXiv:1410.1267. doi:10.1109/TVLSI.2014.2359801. ISSN 1063-8210. S2CID 9647290.
  46. ^ James, A.P.; Francis, L.R.V.J.; Kumar, D.S. (January 1, 2014). "Resistive Threshold Logic". IEEE Transactions on Very Large Scale Integration (VLSI) Systems. 22 (1): 190–195. arXiv:1308.0090. doi:10.1109/TVLSI.2012.2232946. ISSN 1063-8210. S2CID 7357110.
  47. ^ James, A.P.; Kumar, D.S.; Ajayan, A. (November 1, 2015). "Threshold Logic Computing: Memristive-CMOS Circuits for Fast Fourier Transform and Vedic Multiplication". IEEE Transactions on Very Large Scale Integration (VLSI) Systems. 23 (11): 2690–2694. arXiv:1411.5255. doi:10.1109/TVLSI.2014.2371857. ISSN 1063-8210. S2CID 6076956.
  48. ^ Caravelli; et al. (2017). "The complex dynamics of memristive circuits: analytical results and universal slow relaxation". Physical Review E. 95 (2): 022140. arXiv:1608.08651. Bibcode:2017PhRvE..95b2140C. doi:10.1103/PhysRevE.95.022140. PMID 28297937. S2CID 6758362.

External links[edit]