|Arthur Lee Samuel|
|Died||July 29, 1990
|Known for||Samuel Checkers-playing Program|
|Notable awards||Computer Pioneer Award (1987)|
Arthur Lee Samuel (1901 – July 29, 1990) was an American pioneer in the field of computer gaming and artificial intelligence. The Samuel Checkers-playing Program appears to be the world's first self-learning program, and as such a very early demonstration of the fundamental concept of artificial intelligence (AI).
Samuel was born in 1901 in Emporia, Kansas and graduated from College of Emporia in Kansas in 1923. He received a Master’s degree in Electrical Engineering from MIT in 1926, and taught for two years as instructor. In 1928, he joined Bell Laboratories, where he worked mostly on vacuum tubes, including improvements of Radar during World War II. He developed a gas-discharge transmit-receive switch (TR tube) that allowed a single antenna to be used for both transmitting and receiving. After the war he moved to the University of Illinois at Urbana–Champaign, where he initiated the ILLIAC project, but left before its first computer was complete. Samuel went to IBM in Poughkeepsie, New York in 1949, where he would conceive and carry out his most successful work. He is credited with one of the first software hash tables, and influencing early research in using transistors for computers at IBM. At IBM he made the first checkers program on IBM's first commercial computer, the IBM 701. The program was a sensational demonstration of the advances in both hardware and skilled programming and caused IBM's stock to increase 15 points overnight. His pioneering non-numerical programming helped shaped the instruction set of processors, as he was one of the first to work with computers on projects other than computation. He was known for writing articles that made complex subjects easy to understand. He was chosen to write an introduction to one of the earliest journals devoted to computing in 1953.
In 1966, Samuel retired from IBM and became a professor at Stanford, where he worked the remainder of his life. He worked with Donald Knuth on the TeX project, including writing some of the documentation. He continued to write software past his 88th birthday. He was given the Computer Pioneer Award by the IEEE Computer Society in 1987. He died of complications from Parkinson's disease on July 29, 1990.
Computer checkers (draughts) development
Samuel is most known within the AI community for his groundbreaking work in computer checkers. He thought that teaching computers to play games was very fruitful for developing tactics appropriate to general problems, and he chose checkers because it is relatively simple, but has a depth of strategy. The main driver of the machine was a search tree of the board positions reachable from the current state. Since he had only a very limited amount of available computer memory, Samuel implemented what is now called alpha-beta pruning. Instead of searching each path until it came to the game’s conclusion, Samuel developed a scoring function based on the position of the board at any given time. This function tried to measure the chance of winning for each side at the given position. It took into account such things as the number of pieces on each side, the number of kings, and the proximity of pieces to being “kinged”. The program chose its move based on a minimax strategy, meaning it made the move that optimized the value of this function, assuming that the opponent was trying to optimize the value of the same function from its point of view.
Samuel also designed various mechanisms by which his program could become better. In what he called rote learning, the program remembered every position it had already seen, along with the terminal value of the reward function. This technique effectively extended the search depth at each of these positions. Samuel's later programs reevaluated the reward function based on input from professional games. He also had it play thousands of games against itself as another way of learning. With all of this work, Samuel’s program reached a respectable amateur status, and was the first to play any board game at this high a level. He continued to work on checkers until the mid-1970s, at which point his program achieved sufficient skill to challenge a respectable amateur.
- Gio Wiederhold; John McCarthy; Ed Feigenbaum (1990). "Memorial Resolution: Arthur L. Samuel". Stanford University Historical Society. Archived from the original on 26 May 2011. Retrieved April 29, 2011.
- A. L. Samuel, J. W. Clark and W. W. Mumford (1946). "The Gas-Discharge Transmit-Receive Switch". The Bell System technical journal 25: 48–101.
- E. A. Weiss (1992). "Arthur Lee Samuel (1901-90)". IEEE Annals of the History of Computing 14 (3): 55–69. doi:10.1109/85.150082.
- John McCarthy (with additional material by Ed Feigenbaum). "Arthur Samuel: Pioneer in Machine Learning". Archived from the original on 20 April 2011. Retrieved April 29, 2011. (includes links to photos)
- A. L. Samuel (1953). "Computing Bit by Bit or Digital Computers Made Easy". Proceedings of the IRE 41 (10): 1223. doi:10.1109/JRPROC.1953.274271.
- Donald Knuth (1990). "Arthur Lee Samuel, 1901-1990". TUGboat. pp. 497–498. Retrieved April 29, 2011.
- "Past recipients for Computer Pioneer Award". IEEE Computer Society. Retrieved April 29, 2011.
- Richard Sutton (May 30, 1990). "Samuel's Checkers Player". Reinforcement Learning: An Introduction. MIT Press. Retrieved April 29, 2011.
- Arthur, Samuel (1959-03-03). "Some Studies in Machine Learning Using the Game of Checkers" (PDF). IBM Journal 3 (3): 210–229. doi:10.1147/rd.33.0210. Retrieved 2011-10-31.
- Schaeffer, Jonathan. One Jump Ahead: Challenging Human Supremacy in Checkers, 1997,2009, Springer, ISBN 978-0-387-76575-4. Chapter 6.