Peter Stone's Selected Publications

Classified by TopicClassified by Publication TypeSorted by DateSorted by First Author Last NameClassified by Funding Source


Is the Cerebellum a Model-Based Reinforcement Learning Agent?

Is the Cerebellum a Model-Based Reinforcement Learning Agent?.
Bharath Masetty, Reuth Mirsky, Ashish D. Deshpande, Michael Mauk, and Peter Stone.
In Adaptive and Learning Agents Workshop at AAMAS, May 2021.
Video presentation

Download

[PDF]594.9kB  [slides.pdf]1.5MB  

Abstract

The cerebellum is an integral part of the human brain and understanding its role in learning might present an opportunity for reciprocal enrichment of the fields of artificial intelligence and neuroscience. In this paper, we present a novel idea that the cerebellum's role goes beyond functioning as a supervised learning machine to performing model-based reinforcement learning. We revisit the current theories about the cerebellum's role in human learning processes and propose a novel way of evaluating it in the context of the simulated cerebellum. Based on the recent experimental findings, we propose that the cerebellum performs model-based reinforcement learning and we propose a way to evaluate the hypothesis using a simulated cerebellum. Finally, we discuss the necessary conditions to evaluate the hypothesis and the potential implications for future research of the hypothesis holds.

BibTeX Entry

@InProceedings{ALA2021-BHARATH,
  author = {Bharath Masetty and Reuth Mirsky and Ashish D. Deshpande and Michael Mauk and Peter Stone},
  title = {Is the Cerebellum a Model-Based Reinforcement Learning Agent?},
  booktitle = {Adaptive and Learning Agents Workshop at AAMAS},
  location = {Virtual},
  month = {May},
  year = {2021},
  abstract = {
  The cerebellum is an integral part of the human brain and understanding
  its role in learning might present an opportunity for reciprocal enrichment
  of the fields of artificial intelligence and neuroscience. In this paper, 
  we present a novel idea that the cerebellum's role goes beyond functioning
  as a supervised learning machine to performing model-based reinforcement
  learning. We revisit the current theories about the cerebellum's role in
  human learning processes and propose a novel way of evaluating it in the
  context of the simulated cerebellum. Based on the recent experimental
  findings, we propose that the cerebellum performs model-based reinforcement
  learning and we propose a way to evaluate the hypothesis using a simulated
  cerebellum. Finally, we discuss the necessary conditions to evaluate the
  hypothesis and the potential implications for future research of the
  hypothesis holds. 
  },
  wwwnote = {<a href="https://youtu.be/yQ7wM_W8Q8s">Video presentation</a>}
}

Generated by bib2html.pl (written by Patrick Riley ) on Wed Apr 17, 2024 18:42:57