Huang's law
Huang's Law is an observation in computer science and engineering that advancements in graphics processing units (GPU) are growing at a rate much faster than with traditional central processing units (CPU). The observation is in contrast to Moore's law that predicted the number of transistors in a dense integrated circuit (IC) doubles about every two years.[1]
The observation was made by Jensen Huang, chief executive officer of Nvidia, at its 2018 GPU Technology Conference (GTC) held in San Jose, California. He observed that Nvidia’s GPUs were "25 times faster than five years ago"[2] whereas Moore's law would have expected only a ten-fold increase.
For artificial intelligence tasks, Huang said AlexNet took six days on two of Nvidia’s GTX 580 processors to complete the training process but only 18 minutes on a modern DGX-2 AI server, resulting in a speed-up factor of 500. Compared to Moore's law, which focuses purely on CPU transistors, Huang's Law describes a combination of advances in architecture, interconnects, memory technology, and algorithms.[3]
See also
References
- ^ Drum, Kevin. "Moore's Law is dead. Long live Huang's Law".
- ^ "Full Page Reload". IEEE Spectrum: Technology, Engineering, and Science News.
- ^ Mims, Christopher (September 19, 2020). "Huang's Law Is the New Moore's Law, and Explains Why Nvidia Wants Arm" – via www.wsj.com.
 | This computer science article is a stub. You can help Wikipedia by expanding it. |
