Jump to content

Andrew Ng

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Liz (talk | contribs) at 03:29, 3 January 2024 (Removing link(s) Wikipedia:Articles for deletion/DeepLearning.AI closed as delete (XFDcloser)). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

For the physicist, see Andrew Ng (physicist).

Andrew Ng
Ng in 2017
Born
Andrew Yan-Tak Ng

(1976-04-18) April 18, 1976 (age 48)[2][citation needed]
United Kingdom[2]
NationalityBritish
EducationRaffles Institution
Alma materUniversity of California, Berkeley (PhD)
Massachusetts Institute of Technology (MS)
Carnegie Mellon University (BS)
Known forArtificial intelligence, deep learning, MOOC, education technology
Spouse
​
(m. 2014)​
Children2
Awards
Scientific career
FieldsArtificial intelligence, machine learning, natural language processing, computer vision
InstitutionsStanford University
Google Brain
Coursera cofounder
Baidu Research
ThesisShaping and Policy Search in Reinforcement Learning (2003)
Doctoral advisorMichael I. Jordan
Notable studentsIan Goodfellow
David Stavens
Pieter Abbeel
Quoc Viet Le
Ashutosh Saxena
Websitewww.andrewng.org
Andrew Ng
Traditional Chinese吳恩達
Simplified Chinese吴恩达
Transcriptions
Standard Mandarin
Hanyu PinyinWú Ēndá
Yue: Cantonese
Jyutpingng4 jan1 daat6

Andrew Yan-Tak Ng (Chinese: 吳恩達; born 1976) is a British-American computer scientist and technology entrepreneur focusing on machine learning and artificial intelligence (AI).[3] Ng was a cofounder and head of Google Brain and was the former Chief Scientist at Baidu, building the company's Artificial Intelligence Group into a team of several thousand people.[4]

Ng is an adjunct professor at Stanford University (formerly associate professor and Director of its Stanford AI Lab or SAIL). Ng has also worked in the field of online education, cofounding Coursera and DeepLearning.AI.[5] He has spearheaded many efforts to "democratize deep learning" teaching over 2.5 million students through his online courses.[6][3] He is one of the world's most famous and influential computer scientists being named one of Time magazine's 100 Most Influential People in 2012, and Fast Company's Most Creative People in 2014. In 2018, he launched and currently heads the AI Fund, initially a $175-million investment fund for backing artificial intelligence startups. He has founded Landing AI, which provides AI-powered SaaS products.[7]

Biography

Ng was born in the United Kingdom in 1976. His parents Ronald P. Ng and Tisa Ho[8][9][10] are both immigrants from Hong Kong. He has at least one brother.[9] Growing up, he spent time in Hong Kong and Singapore.[2]

In 1997, he earned his undergraduate degree with a triple major in computer science, statistics, and economics from Carnegie Mellon University in Pittsburgh, Pennsylvania, graduating at the top of his class. Between 1996 and 1998 he also conducted research on reinforcement learning, model selection, and feature selection at the AT&T Bell Labs.[11]

In 1998 Ng earned his master's degree in Electrical Engineering and Computer Science from the Massachusetts Institute of Technology (MIT) in Cambridge, Massachusetts. At MIT he built the first publicly available, automatically indexed web-search engine for research papers on the web. It was a precursor to CiteSeerX/ResearchIndex, but specialized in machine learning.[11]

In 2002, he received his Doctor of Philosophy (Ph.D.) in Computer Science from the University of California, Berkeley, under the supervision of Michael I. Jordan. His thesis is titled "Shaping and policy search in reinforcement learning" and is well-cited to this day.[11][12]

He started working as an assistant professor at Stanford University in 2002 and as an associate professor in 2009.[13]

He currently lives in Los Altos Hills, California. In 2014, he married Carol E. Reiley.[14] They have two children: a daughter born in 2019[15] and a son born in 2021.[16] The MIT Technology Review named Ng and Reiley an "AI power couple".[17][18]

Career

Academia and teaching

Ng is a professor at Stanford University departments of Computer Science and electrical engineering. He served as the director of the Stanford Artificial Intelligence Laboratory (SAIL), where he taught students and undertook research related to data mining, big data, and machine learning. His machine learning course CS229 at Stanford is the most popular course offered on campus with over 1,000 students enrolling some years.[19][20] As of 2020, three of most popular courses on Coursera are Ng's: Machine Learning (#1), AI for Everyone, (#5), Neural Networks and Deep Learning (#6).[21]

In 2008 his group at Stanford was one of the first in the US to start advocating the use of GPUs in deep learning[citation needed]. The rationale was that an efficient computation infrastructure could speed up statistical model training by orders of magnitude, ameliorating some of the scaling issues associated with big data. At the time it was a controversial and risky decision, but since then and following Ng's lead, GPUs have become a cornerstone in the field.[22] Since 2017 Ng has been advocating the shift to high-performance computing (HPC) for scaling up deep learning and accelerating progress in the field.[22]

In 2012, along with Stanford computer scientist Daphne Koller he cofounded and was CEO of Coursera, a website that offers free online courses to everyone.[3][failed verification] It took off with over 100,000 students registered for Ng's popular CS229A course.[23] Today, several million people have enrolled in Coursera courses, making the site one of the leading massive open online courses (MOOCs) in the world.

Industry

From 2011 to 2012, he worked at Google, where he founded and directed the Google Brain Deep Learning Project with Jeff Dean, Greg Corrado, and Rajat Monga.

In 2014, he joined Baidu as chief scientist, and carried out research related to big data and AI.[24] There he set up several research teams for things like facial recognition and Melody, an AI chatbot for healthcare.[4] He also developed for the company the AI platform called DuerOS and other technologies that positioned Baidu ahead of Google in the discourse and development of AI.[25] In March 2017, he announced his resignation from Baidu.[3][26]

He soon afterward launched Deeplearning.ai, an online series of deep learning courses (including the AI for Good Specialization).[27] Then Ng launched Landing AI, which provides AI-powered SaaS products.[28]

In January 2018, Ng unveiled the AI Fund, raising $175 million to invest in new startups.[29] In November 2021, Landing AI secured a $57 million round of series A funding led by McRock Capital, to help manufacturers adopt computer vision.[30]

Research

Ng researches primarily in machine learning, deep learning, machine perception, computer vision, and natural language processing; and is one of the world's most famous and influential computer scientists.[31] He's frequently won best paper awards at academic conferences and has had a huge impact on the field of AI, computer vision, and robotics.[32][33]

During graduate school, together with David M. Blei and Michael I. Jordan, Ng coauthored the influential paper that introduced latent Dirichlet allocation (LDA) for his thesis on reinforcement learning for drones.[34]

His early work includes the Stanford Autonomous Helicopter project, which developed one of the most capable autonomous helicopters in the world.[35][36] He was the leading scientist and principal investigator on the STAIR (Stanford Artificial Intelligence Robot) project,[37] which resulted in Robot Operating System (ROS), a widely used open source software robotics platform. His vision to build an AI robot and put a robot in every home inspired Scott Hassan to back him and create Willow Garage.[38] He is also one of the founding team members for the Stanford WordNet project, which uses machine learning to expand the Princeton WordNet database created by Christiane Fellbaum.[11][39]

In 2011, Ng founded the Google Brain project at Google, which developed large-scale artificial neural networks using Google's distributed computing infrastructure.[40] Among its notable results was a neural network trained using deep learning algorithms on 16,000 CPU cores, which learned to recognize cats after watching only YouTube videos, and without ever having been told what a "cat" is.[41][42] The project's technology is also currently used in the Android operating system's speech recognition system.[43]

Online education: massive open online course

External audio
audio icon Interview with Coursera Co-Founder Andrew Ng, Degree of Freedom[44]

In 2011, Stanford launched a total of three massive open online course (MOOCs) on machine learning (CS229a), databases, and AI, taught by Ng, Peter Norvig, Sebastian Thrun, and Jennifer Widom.[45][46] This has led to the modern MOOC movement. Ng taught machine learning and Widom taught databases. The course on AI taught by Thrun led to the genesis of Udacity.[45] Coursera was the 6th online education website that Ng built and arguably the most successful to date.[47]

But we learned and learned and learned from the early prototypes, until in 2011 we managed to build something that really took off.[47]

The seeds of massive open online courses (MOOCs) go back a few years before the founding of Coursera in 2012. Two themes emphasized in the founding of modern MOOCs were scale and availability.[45]

Founding of Coursera

Ng started the Stanford Engineering Everywhere (SEE) program, which in 2008 published a number of Stanford courses online for free. Ng taught one of these courses, "Machine Learning", which includes his video lectures, along with the student materials used in the Stanford CS229 class. It offered a similar experience to MIT OpenCourseWare, except it aimed at providing a more "complete course" experience, equipped with lectures, course materials, problems and solutions, etc. The SEE videos were viewed by the millions and inspired Ng to develop and iterate new versions of online tech.[45]

Within Stanford, they include Daphne Koller with her "blended learning experiences" and codesigning a peer-grading system, John Mitchell (Courseware, a Learning Management System), Dan Boneh (using machine learning to sync videos, later teaching cryptography on Coursera), Bernd Girod (ClassX), and others. Outside Stanford, Ng and Thrun credit Sal Khan of Khan Academy as a huge source of inspiration. Ng was also inspired by lynda.com and the design of the forums of Stack Overflow.[45]

Widom, Ng, and others were ardent advocates of Khan-styled tablet recordings, and between 2009 and 2011, several hundred hours of lecture videos recorded by Stanford instructors were recorded and uploaded. Ng tested some of the original designs with a local high school to figure the best practices for recording lessons.[45]

In October 2011, the "applied" version of the Stanford class (CS229a) was hosted on ml-class.org and launched, with over 100,000 students registered for its first edition. The course featured quizzes and graded programming assignments and became one of the first and most successful massive open online courses (MOOCs) created by a Stanford professor.[48]

Two other courses on databases (db-class.org) and AI (ai-class.org) were launched. The ml-class and db-class ran on a platform developed by students, including Frank Chen, Jiquan Ngiam, Chuan-Yu Foo, and Yifan Mai. Word spread through social media and popular press. The three courses were 10 weeks long, and over 40,000 "Statements of Accomplishment" were awarded.[45]

Ng tells the following story on the early days of Coursera:

In 2011, I was working with four Stanford students. We were under tremendous pressure to build new features for the 100,000+ students that were already signed up. One of the students (Frank Chen) claims another one (Jiquan Ngiam) frequently stranded him in the Stanford building and refused to give him a ride back to his dorm until very late at night so he had no choice but to stick around and keep working. I neither confirm nor deny this story.[47]

His work subsequently led to his founding of Coursera with Koller in 2012. As of 2019, the two most popular courses on the platform were taught and designed by Ng: "Machine Learning" (#1) and "Neural Networks and Deep Learning" (#2).

Post-Coursera work

In 2019, Ng launched a new course "AI for Everyone". This is a non-technical course designed to help people understand AI's impact on society and its benefits and costs for companies, as well as how they can navigate through this technological revolution.[49]

Venture capital

Ng is the chair of the board for Woebot Labs, a psychological clinic that uses data science to provide cognitive behavioral therapy. It provides a therapy chatbot to help treat depression, among other things.[50]

He is also a member of the board of directors for drive.ai, which uses AI for self-driving cars and was acquired by Apple in 2019.[51][52]

Through Landing AI, he also focuses on democratizing AI technology and lowering the barrier for entrance to businesses and developers.[7]

Publications and awards

Ng is also the author or co-author of over 300 publications in robotics, and related fields.[53] His work in computer vision and deep learning has been featured often in press releases and reviews.[54]


He has corefereed hundreds of AI publications in journals like NeurIPS. He has also been the editor of the Journal of Artificial Intelligence Research (JAIR), Associate Editor for the IEEE Robotics and Automation Society Conference Editorial Board (ICRA), and much more.[11]

He has given invited talks at NASA, Google, Microsoft, Lockheed Martin, the Max Planck Society, Stanford, Princeton, UPenn, Cornell, MIT, UC Berkeley, and dozens of other universities. Outside of the US, he has lectured in Spain, Germany, Israel, China, Korea, and Canada.[11]

He has also written for Harvard Business Review, HuffPost, Slate, Apple News, and Quora Sessions' Twitter.[66] He also writes a weekly digital newsletter called The Batch.

Books

He also wrote a book Machine Learning Yearning, a practical guide for those interested in machine learning, which he distributed for free.[67] In December 2018, he wrote a sequel called AI Transformation Playbook.[68]

Ng contributed one chapter to Architects of Intelligence: The Truth About AI from the People Building it (2018) by the American futurist Martin Ford.

Views on AI

Ng believes that AI technology will improve the lives of people, not that it is an anathema that will "enslave" the human race.[4] Ng believes the potential benefits of AI outweigh the threats, which he believes are exaggerated.[69] He has stated that

Worrying about AI evil superintelligence today is like worrying about overpopulation on the planet Mars. We haven't even landed on the planet yet![69]

A real threat is regarding the future of work: "Rather than being distracted by evil killer robots, the challenge to labor caused by these machines is a conversation that academia and industry and government should have."[70] A particular goal of Ng's work is to "democratize" AI learning so that people can learn more about it and understand its benefits. Ng's stance on AI is shared by Mark Zuckerberg, but opposed by Elon Musk.[70]

In 2017, Ng said he supported basic income to allow the unemployed to study AI so that they can re-enter the workforce. He has stated that he enjoyed Erik Brynjolfsson and Andrew McAfee's "The Second Machine Age" which discusses issues such as AI displacement of jobs.[71]

See also

References

  1. ^ "Andrew Ng". Time Magazine. September 7, 2023. Retrieved November 7, 2023.
  2. ^ a b c Seligman, Katherine (December 3, 2006). "If Andrew Ng could just get his robot to assemble an Ikea bookshelf, we'd all buy one". SFGate. Retrieved February 12, 2013.
  3. ^ a b c d Terdiman, Daniel (March 22, 2017). "Baidu's head of artificial intelligence is stepping down". Fast Company. Retrieved April 17, 2019.
  4. ^ a b c Mozur, Paul (March 22, 2017). "A.I. Expert at Baidu, Andrew Ng, Resigns From Chinese Search Giant". The New York Times. ISSN 0362-4331. Retrieved April 17, 2019.
  5. ^ "Andrew Ng – Stanford University". Coursera. Retrieved August 29, 2017.
  6. ^ Andrew Ng at Amazon re: MARS 2019, archived from the original on December 20, 2021, retrieved November 20, 2019
  7. ^ a b "Home". Landing AI. Retrieved April 17, 2019.
  8. ^ Ng, Terry (September 26, 2020). "After His Son Co-Founded Coursera, He Became Its Earliest Student and Completed 146 Courses". Rice Media.
  9. ^ a b "Healer, teacher". The Straits Times. Retrieved February 25, 2022.
  10. ^ Miquiabas, Bong (July 2015). "A.I. and the New Era of Business" (PDF). The Peak Magazine Hong Kong: 40–45.
  11. ^ a b c d e f Ng, Andrew. "Cirriculum Vitae: Andrew Y. Ng" (PDF).
  12. ^ Ng, Andrew (2003). Shaping and policy search in Reinforcement Learning (PDF). Robotic AI & Learning Lab (RAIL) (Thesis). University of California, Berkeley.
  13. ^ Ng, Andrew Y. (May 20, 2015). "Curriculum Vitæ: Andrew Y. Ng" (PDF). Stanford Artificial Intelligence Laboratory. Retrieved October 9, 2020.
  14. ^ "Inside The Mind That Built Google Brain: On Life, Creativity, And Failure". The Huffington Post. May 13, 2015. Retrieved December 19, 2015.
  15. ^ Ng, Andrew (February 20, 2019). "Announcing Nova Ng, our first daughter. Plus, some thoughts on the AI-powered world she will grow up in..." @AndrewYNg. Retrieved March 7, 2019.
  16. ^ Ng, Andrew (August 25, 2021). "Dear friends". DeepLearning.ai: The Batch. No. 106.
  17. ^ Technology Review, MIT [@techreview] (December 2, 2016). "Register today to hear power couple @AndrewYNg and @robot_MD speak at #EmTechDigital this March - http://trib.al/WHpHY91" (Tweet). Archived from the original on June 28, 2023. Retrieved June 28, 2023 – via Twitter.
  18. ^ Ng, Andrew [@AndrewYNg] (December 2, 2016). "MIT Tech Review just called Carol @robot_MD and me a "power couple." :-)" (Tweet). Archived from the original on June 28, 2023. Retrieved June 28, 2023 – via Twitter.
  19. ^ Kosner, Anthony Wing (December 29, 2013). "Why Is Machine Learning (CS 229) The Most Popular Course At Stanford?". Forbes.
  20. ^ "CS229: Machine Learning". cs229.stanford.edu. Retrieved April 17, 2019.
  21. ^ Mundial, Foro Económico (October 27, 2020). "Coursera's Most Popular Online Courses". Entrepreneur. Retrieved December 26, 2020.
  22. ^ a b "What does Andrew Ng think about Deep Learning? – Quora". quora.com. Retrieved April 17, 2019.
  23. ^ Friedman, Thomas L. (May 15, 2012). "Opinion: Come the Revolution". The New York Times. ISSN 0362-4331. Retrieved February 19, 2018.
  24. ^ Gannes, Liz (May 16, 2014). "Baidu Hires Coursera Founder Andrew Ng to Start Massive Research Lab". Recode. Retrieved August 29, 2017.
  25. ^ Webb, Amy (2019). The Big Nine: How the Tech Titans and Their Thinking Machines Could Warp Humanity. New York: PublicAffairs. ISBN 978-1-5417-7374-5.
  26. ^ "Opening a new chapter of my work in AI". 2017. Retrieved May 16, 2014.
  27. ^ Ng, Andrew (August 8, 2017). "deeplearning.ai: Announcing new Deep Learning courses on Coursera". Medium. Retrieved February 19, 2018.
  28. ^ Lardinois, Frederic (August 21, 2019). "Andrew Ng's AI companies expand to Medellin, Colombia". TechCrunch. Retrieved June 2, 2023.
  29. ^ Frank, Blair Hanley (January 30, 2018). "Andrew Ng unveils the AI Fund, with $175 million to back new startups". VentureBeat. Retrieved February 19, 2018.
  30. ^ "MLOps platform Landing AI raises $57M to help manufacturers adopt computer vision". VentureBeat. November 8, 2021. Retrieved November 9, 2021.
  31. ^ "One of the world's most famous computer scientists reveals his 'playbook' for bringing AI to every business". Business Insider. 2018.
  32. ^ "Andrew Ng – Publications". www.robotics.stanford.edu. Retrieved December 26, 2020.
  33. ^ "publications". ai.stanford.edu. Retrieved December 26, 2020.
  34. ^ David M. Blei, Andrew Y. Ng, Michael I. Jordan. Latent Dirichlet allocation. The Journal of Machine Learning Research, Volume 3, January 3, 2003, which is one of the two papers that independently discovered Latent Dirichlet allocation
  35. ^ "From Self-Flying Helicopters to Classrooms of the Future". Chronicle of Higher Education. 2012.
  36. ^ "Stanford Autonomous Helicopter Project".
  37. ^ Markoff, John (July 18, 2006). "Brainy Robots Start Stepping Into Daily Life". The New York Times.
  38. ^ Markoff, John (2015). Machines of Loving Grace: The Quest for Common Ground between humans and robots. New York: HarperCollins. ISBN 978-0-06-226668-2.
  39. ^ "The Stanford Wordnet Project". ai.stanford.edu. Retrieved April 17, 2019.
  40. ^ Miller, Claire; Bilton, Nick (November 3, 2011). "Google's Lab of Wildest Dreams". The New York Times.
  41. ^ Markoff, John (June 25, 2012). "How Many Computers to Identify a Cat? 16,000". The New York Times.
  42. ^ Ng, Andrew; Dean, Jeff (2012). "Building High-level Features Using Large Scale Unsupervised Learning". arXiv:1112.6209 [cs.LG].
  43. ^ "Speech Recognition and Deep Learning". Google Research Blog. August 6, 2012. Retrieved January 29, 2013.
  44. ^ "Interview with Coursera Co-Founder Andrew Ng". Degree of Freedom. May 17, 2013. Retrieved May 19, 2013.
  45. ^ a b c d e f g Ng, Andrew; Widom, Jennifer. "Origins of the Modern MOOC". Archived from the original on June 2, 2017. Retrieved April 17, 2019.
  46. ^ Ng, Andrew; Widom, Jennifer. "Origins of the Modern MOOC (xMOOC)" (PDF).
  47. ^ a b c "What are some good stories from the early days of Coursera? – Quora". quora.com. Retrieved April 17, 2019.
  48. ^ Johnson, Theresa (September–October 2012). "Stanford for All". Stanford Magazine.
  49. ^ Ng, Andrew (November 14, 2018). "Announcing "AI for Everyone": a new course from deeplearning.ai". Medium. Retrieved December 14, 2018.
  50. ^ "Woebot – Your charming robot friend who is here for you, 24/7". woebot.io. Retrieved April 17, 2019.
  51. ^ "Andrew Ng LinkedIn page".
  52. ^ "The self-driving car is here". drive.ai. Archived from the original on April 17, 2019. Retrieved April 17, 2019.
  53. ^ "Andrew Ng – Google Scholar Citations". scholar.google.com. Retrieved December 14, 2018.
  54. ^ New algorithm improves robot vision
  55. ^ a b c d e "Andrew Ng's CV" (PDF).
  56. ^ "SCS Alumni Awards". School of Computer Science. Pittsburgh, Pennsylvania: Carnegie Mellon University. 2009. Retrieved January 23, 2023.
  57. ^ "Innovators Under 35 2008". Technology Review. Massachusetts Institute of Technology. 2008. Retrieved August 15, 2011.
  58. ^ "Technology Review: TR35". Archived from the original on October 18, 2012. Retrieved December 2, 2009.
  59. ^ "IJCAI Awards". IJCAI.org. 2009. Retrieved December 26, 2020.
  60. ^ at the age of 37 Emanuel, Ezekiel. "The 2013 Time 100". Time. ISSN 0040-781X. Retrieved February 19, 2018.
  61. ^ "Fortune's 40 under 40 – The hottest young stars in business". Fortune. Retrieved February 19, 2018.
  62. ^ "The CNN 10: Thinkers". CNN. Retrieved December 26, 2020.
  63. ^ Staff, Fast Company (January 29, 2014). "Most Creative People In Business 1000: The Complete List". Fast Company. Retrieved December 26, 2020.
  64. ^ "Convening Innovators from the Science and Technology Communities" (PDF). World Economic Forum. September 2014.
  65. ^ "The 2023 Time AI 100". Time. September 7, 2023. ISSN 0040-781X. Retrieved September 8, 2023.
  66. ^ "Andrew Ng – Quora". quora.com. Retrieved April 17, 2019.
  67. ^ "Machine Learning Yearning". 2017.
  68. ^ "AI Transformation Playbook How to lead your company into the AI era". Landing AI. December 13, 2018. Retrieved December 14, 2018.
  69. ^ a b "Is AI an existential threat to humanity? – Quora". quora.com. Retrieved April 17, 2019.
  70. ^ a b Thieme, Nick (August 1, 2017). "Zuckerberg and Musk are arguing about the dangers of AI – they're both wrong". The Straits Times. Retrieved December 26, 2020.
  71. ^ "How will work and jobs change by 2035? – Quora". quora.com. Retrieved April 17, 2019.
Wikimedia Commons has media related to Andrew Ng.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Andrew_Ng&oldid=1193304350"