David Silver (computer scientist)

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search

David Silver (born 1976) leads the reinforcement learning research group at DeepMind and was lead researcher on AlphaGo, AlphaZero and co-lead on AlphaStar.

He graduated from Cambridge University in 1997 with the Addison-Wesley award, and befriended Demis Hassabis whilst there.[1] Subsequently, Silver co-founded the video games company Elixir Studios, where he was CTO and lead programmer, receiving several awards for technology and innovation.[1][2]

Silver returned to academia in 2004 at the University of Alberta to study for a PhD on reinforcement learning, where he co-introduced the algorithms used in the first master-level 9×9 Go programs.[3][4] His version of program MoGo (co-authored with Sylvain Gelly) was one of the strongest Go programs as of 2009.[5]

Silver was awarded a Royal Society University Research Fellowship in 2011, and subsequently became a lecturer at University College London, where he is now a professor.[6] His lectures on Reinforcement Learning are available on YouTube.[7] Silver consulted for DeepMind from its inception, joining full-time in 2013.

His recent work has focused on combining reinforcement learning with deep learning, including a program that learns to play Atari games directly from pixels.[8] Silver led the AlphaGo project, culminating in the first program to defeat a top professional player in the full-size game of Go.[9] AlphaGo subsequently received an honorary 9 Dan Professional Certification; and won the Cannes Lion award for innovation.[10] He then led development of AlphaZero, which used the same AI to learn to play Go from scratch (learning only by playing itself and not from human games) before learning to play chess and shogi in the same way, to higher levels than any other computer program.

Silver is among the most published members of staff at DeepMind, with over 57,000 citations and has an h-index of 64.[11]

He was awarded the 2019 ACM Prize in Computing for breakthrough advances in computer game-playing.[12]

References[edit]

  1. ^ a b Shead, Sam. "David Silver: The unsung hero and intellectual powerhouse at Google DeepMind". Business Insider. Retrieved 26 September 2020.
  2. ^ "What the AI Behind AlphaGo Can Teach Us About Being Human". Wired.com. Retrieved 17 May 2016.
  3. ^ David, Silver (2009). "Reinforcement Learning and Simulation-Based Search in Computer Go". ERA. doi:10.7939/R39D8T.
  4. ^ Sylvain Gelly, David Silver (2008). "Achieving Master Level Play in 9 × 9 Computer Go" (PDF). Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence.CS1 maint: uses authors parameter (link)
  5. ^ Stuart J. Russell, Peter Norvig (2009). Artificial Intelligence: A Modern Approach (3rd ed.). Prentice Hall.CS1 maint: uses authors parameter (link)
  6. ^ "CSML | David Silver". www.csml.ucl.ac.uk. Retrieved 27 May 2017.
  7. ^ "RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning". 13 May 2015 – via YouTube.
  8. ^ Mnih, Volodymyr; Kavukcuoglu, Koray; Silver, David; Rusu, Andrei A.; Veness, Joel; Bellemare, Marc G.; Graves, Alex; Riedmiller, Martin; Fidjeland, Andreas K. (26 February 2015). "Human-level control through deep reinforcement learning". Nature. 518 (7540): 529–533. Bibcode:2015Natur.518..529M. doi:10.1038/nature14236. ISSN 0028-0836. PMID 25719670. S2CID 205242740.
  9. ^ Silver, David; Huang, Aja; Maddison, Chris J.; Guez, Arthur; Sifre, Laurent; Driessche, George van den; Schrittwieser, Julian; Antonoglou, Ioannis; Panneershelvam, Veda; Lanctot, Marc; Dieleman, Sander; Grewe, Dominik; Nham, John; Kalchbrenner, Nal; Sutskever, Ilya; Lillicrap, Timothy; Leach, Madeleine; Kavukcuoglu, Koray; Graepel, Thore; Hassabis, Demis (28 January 2016). "Mastering the game of Go with deep neural networks and tree search". Nature. 529 (7587): 484–489. Bibcode:2016Natur.529..484S. doi:10.1038/nature16961. ISSN 0028-0836. PMID 26819042. S2CID 515925.closed access
  10. ^ "Google DeepMind AlphaGo in U.K. Wins Innovation Grand Prix". Retrieved 27 May 2017.
  11. ^ "David Silver – Google Scholar Citations". Retrieved 13 October 2020.
  12. ^ Ormond, Jim. "ACM Prize in Computing Awarded to AlphaGo Developer: David Silver Recognized for Breakthrough Advances in Computer Game-Playing". acm.org. Retrieved 2 April 2020.