November 18th, 4:30pm PST
Dr. Andrew G. Barto, Professor Emeritus of Computer Science at the University of Massachusetts Amherst, is a pioneering researcher in reinforcement learning. He co-authored, together with Richard S. Sutton, the influential textbook 'Reinforcement Learning: An Introduction', which has become a foundational reference in the field. His research explores computational models of learning and decision-making in machines and animals, including links between reinforcement learning and neuroscience. In 2025, he and Sutton were awarded the A.M. Turing Award for their work developing the conceptual and algorithmic foundations of reinforcement learning.
Biography +
Andrew G. Barto
Early Life and Education
Andrew G. Barto is a distinguished researcher who has made fundamental contributions to the field of reinforcement learning and computational neuroscience.
Education
University of Michigan
- Earned a Bachelor of Science in Mathematics in 1970
- Developed a strong foundation in mathematical theory that would inform his later work in computational learning
University of Massachusetts Amherst
- Obtained his Ph.D. from UMass Amherst
- His doctoral research laid the groundwork for his pioneering work in computational models of learning
Academic Career
University of Massachusetts Amherst (1977-present)
Dr. Barto joined the University of Massachusetts Amherst in 1977 and has been a central figure in the computer science department ever since. He served as a professor and department chair, helping to shape the direction of computer science research and education at the institution. Upon retirement, he was granted the title of Professor Emeritus in recognition of his distinguished career.
Major Contributions
Reinforcement Learning Foundations
Together with Richard S. Sutton, Dr. Barto developed the conceptual and algorithmic foundations of reinforcement learning, establishing it as a major paradigm in machine learning and artificial intelligence. Their work has enabled machines to learn through trial and error, similar to how humans and animals learn from experience.
Reinforcement Learning: An Introduction
Dr. Barto co-authored with Richard S. Sutton the seminal textbook "Reinforcement Learning: An Introduction," which has become the definitive reference in the field. The book has educated generations of researchers and practitioners and continues to be widely used in academic courses and industry applications worldwide.
Computational Neuroscience
His research explores the connections between reinforcement learning algorithms and neuroscience, investigating how computational models can explain learning and decision-making in biological systems. This interdisciplinary work has contributed to our understanding of both artificial and natural intelligence.
Learning and Decision-Making Models
Dr. Barto's work encompasses computational models that explain how both machines and animals make decisions and learn from their environments. His contributions have influenced fields ranging from robotics and autonomous systems to cognitive science and psychology.
Legacy
Dr. Andrew G. Barto's contributions to reinforcement learning have had a profound and lasting impact on artificial intelligence, machine learning, and neuroscience. His work, particularly with Richard S. Sutton, has established the theoretical and practical foundations that underpin modern AI systems, including applications in robotics, game playing, autonomous vehicles, and recommendation systems. The 2025 Turing Award recognition affirms the fundamental importance of his work to the field of computing.
Career Timeline +
Career Timeline
- 1970: Graduated from University of Michigan with a B.S. in Mathematics
- 1977: Joined University of Massachusetts Amherst as a faculty member
- 1977-present: Professor of Computer Science at UMass Amherst
- Served as: Department Chair of Computer Science at UMass Amherst
- Co-authored: "Reinforcement Learning: An Introduction" with Richard S. Sutton (first edition 1998, second edition 2018)
- 2025: Awarded the ACM Turing Award (with Richard S. Sutton) for developing the conceptual and algorithmic foundations of reinforcement learning
- Present: Professor Emeritus at University of Massachusetts Amherst
Awards and Honors
- ACM Turing Award (2025): Awarded jointly with Richard S. Sutton for their foundational contributions to reinforcement learning
- Professor Emeritus: University of Massachusetts Amherst
- Pioneering Researcher: Recognized as one of the founders of modern reinforcement learning
- Influential Author: Co-author of the most widely-used textbook on reinforcement learning