2026-09-19T02:31:40Zhttps://ecommons.cornell.edu/server/oai/request

oai:ecommons.cornell.edu:1813/1030222026-05-15T19:51:49Zcom_1813_35col_1813_47

Chen, Ruidong Goldberg, Jesse H. Fetcho, Joseph R. Warden, Melissa Dudman, Joshua 2021-03-12T17:41:03Z 2022-08-27T06:00:25Z 2020-08 ProQuest Submission ID: 12171 ProQuest Publication ID: 28086797 https://hdl.handle.net/1813/103022 https://doi.org/10.7298/4rrq-1656 13277685 119 pages Reinforcement learning (RL) is one of the most successful theories in the intersection between animal behavior, neural basis of learning, and artificial intelligence. RL-like computation in the brain is evidenced by representation of a key variable in the dopaminergic system, the reward prediction error. Yet most studies of the dopaminergic system have been in situations where an animal is motivated by external rewards, such as food or juice. Does RL apply to learning of complex behavior without immediate external reward? What are the neural circuits responsible for learning a motor sequence such as birdsong? Here I introduce work in the songbird zebra finch demonstrating RL applies to performance learning based on a flexible internal benchmark. Dopaminergic neurons in the midbrain were shown to report a performance prediction error. I expand the song system involved in song learning to neural circuits responsible for RL. I found ventral pallidum (VP), a major input area to the dopaminergic midbrain, to be involved in song learning. I discovered a rich representation in VP including performance prediction related activity that is signaled to the dopaminergic midbrain. I contextualize my findings in the songbird system and hypothesize a consolidator-actor-critic architecture for song learning. I discovered neural representations in VP and the dopaminergic midbrain that switch between body movement and song timing depending on the animal’s behavioral states of singing and non-singing. I also report the first neural recordings from a parrot. Surprisingly, representations of both vocalization and body movements were found in the parrot primary vocal motor cortex. This finding sets up the foundation for future neurophysiological studies of social behavior in the parrot. en NEURAL BASIS OF PERFORMANCE EVALUATION IN BIRDS dissertation or thesis https://catalog.library.cornell.edu/catalog/13277685 application/pdf Neurobiology and Behavior Cornell University Doctor of Philosophy Ph. D., Neurobiology and Behavior https://hdl.handle.net/1813/59810 Publication Cornell Theses and Dissertations Chen, Ruidong 5893a6ea-7af3-41d7-abc6-04bcd26ab5df open.access open.access <Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="01c014f8-fc63-4d11-9e06-dbc50ca23361"> <Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843</Type> <Language>en</Language> <Title>NEURAL BASIS OF PERFORMANCE EVALUATION IN BIRDS</Title> <PublishedIn> <Publication> </Publication> </PublishedIn> <PublicationDate>2020-08</PublicationDate> <DOI>https://doi.org/10.7298/4rrq-1656</DOI> <Authors> <Author> <DisplayName>Chen, Ruidong</DisplayName> <Affiliation> <OrgUnit> </OrgUnit> </Affiliation> </Author> </Authors> <Editors> </Editors> <Publishers> <Publisher> <OrgUnit /> </Publisher> </Publishers> <Abstract>Reinforcement learning (RL) is one of the most successful theories in the intersection between animal behavior, neural basis of learning, and artificial intelligence. RL-like computation in the brain is evidenced by representation of a key variable in the dopaminergic system, the reward prediction error. Yet most studies of the dopaminergic system have been in situations where an animal is motivated by external rewards, such as food or juice. Does RL apply to learning of complex behavior without immediate external reward? What are the neural circuits responsible for learning a motor sequence such as birdsong? Here I introduce work in the songbird zebra finch demonstrating RL applies to performance learning based on a flexible internal benchmark. Dopaminergic neurons in the midbrain were shown to report a performance prediction error. I expand the song system involved in song learning to neural circuits responsible for RL. I found ventral pallidum (VP), a major input area to the dopaminergic midbrain, to be involved in song learning. I discovered a rich representation in VP including performance prediction related activity that is signaled to the dopaminergic midbrain. I contextualize my findings in the songbird system and hypothesize a consolidator-actor-critic architecture for song learning. I discovered neural representations in VP and the dopaminergic midbrain that switch between body movement and song timing depending on the animal’s behavioral states of singing and non-singing. I also report the first neural recordings from a parrot. Surprisingly, representations of both vocalization and body movements were found in the parrot primary vocal motor cortex. This finding sets up the foundation for future neurophysiological studies of social behavior in the parrot.</Abstract> <Access xmlns="http://purl.org/coar/access_right" > </Access> </Publication>