Léon Bottou is a researcher best known for his work in machine learning and data compression. His work presents stochastic gradient descent as a fundamental learning algorithm. He is also one of the main creators of the DjVu image compression technology (together with Yann LeCun and Patrick Haffner), and the maintainer of DjVuLibre, the open source implementation of DjVu. He is the original developer of the Lush programming language.
Léon Bottou was born in France in 1965. He obtained the Diplôme d'Ingénieur from École Polytechnique in 1987, and a PhD from Université Paris-Sud in 1991. He then joined the Adaptive Systems Research Department at AT&T Bell Laboratories in Holmdel, NJ where he collaborated with Vladimir Vapnik on local learning algorithms. in 1992, he returned to France and founded Neuristique S.A., a company that produced machine learning and one of the first data mining software. In 1995, he returned to Bell Laboratories, where he developed a number of new machine learning methods, such as Graph Transformer Networks (similar to conditional random field), and applied them to handwriting recognition and OCR. The bank check recognition system that he helped develop was widely deployed by NCR and other companies, reading over 10% of all the checks in the US in the late 90s and early 00s.
In 1996, he joined AT&T Labs and worked primarily on the DjVu image compression technology, used by many websites, notably the Internet Archive, to distribute scanned documents. Since 2002, he has been a research scientist at NEC Laboratories in Princeton, NJ, where he has focused on the theory and practice of machine learning with very large-scale datasets, on-line learning, and stochastic optimization methods. He developed the open source software LaSVM for fast large-scale support vector machine, and stochastic gradient descent software for training linear SVM and Conditional Random Fields.
He is associate editor of the Journal of Machine Learning Research, the IEEE Transactions on Pattern Analysis and Machine Intelligence, and Pattern Recognition Letters.
- Vladimir N. Vapnik and Léon Bottou: Local Algorithms for Pattern Recognition and Dependencies Estimation, Neural Computation, 5(6):893–909, 1993.
- Yann LeCun, Léon Bottou, Yoshua Bengio and Patrick Haffner: Gradient Based Learning Applied to Document Recognition, Proceedings of IEEE, 86(11):2278–2324, 1998.
- Léon Bottou, Patrick Haffner, Paul G. Howard, Patrice Simard, Yoshua Bengio and Yann LeCun: High Quality Document Image Compression with DjVu, Journal of Electronic Imaging, 7(3):410–425, 1998.
- Large Scale Kernel Machines, Edited by Léon Bottou, Olivier Chapelle, Dennis DeCoste, and Jason Weston, Neural Information Processing Series, MIT Press, Cambridge, MA., 2007
- Léon Bottou: Stochastic Learning, Advanced Lectures on Machine Learning, 146–168, Edited by Olivier Bousquet and Ulrike von Luxburg, Lecture Notes in Artificial Intelligence, LNAI 3176, Springer Verlag, Berlin, 2004