Cornell University
Library
Cornell UniversityLibrary

eCommons

Help
Log In(current)
  1. Home
  2. Cornell University Graduate School
  3. Cornell Theses and Dissertations
  4. Experimental Design For Partially Observed Markov Decision Processes

Experimental Design For Partially Observed Markov Decision Processes

File(s)
lt274.pdf (592.44 KB)
Permanent Link(s)
https://hdl.handle.net/1813/38999
Collections
Cornell Theses and Dissertations
Author
Thorbergsson, Leifur
Abstract

This thesis considers the question of how to most effectively conduct experiments in Partially Observed Markov Decision Processes so as to provide data that is most informative about a parameter of interest. Methods from Markov decision processes, especially dynamic programming, are introduced and then used in algorithms to maximize a relevant Fisher Information. These algorithms are then applied to two POMDP examples. The methods developed can also be applied to stochastic dynamical systems, by suitable discretization, and we consequently show what control policies look like in the Morris-Lecar Neuron model and the Rosenzweig MacArthur Model, and simulation results are presented. We discuss how parameter dependence within these methods can be dealt with by the use of priors, and develop tools to update control policies online. This is demonstrated in another stochastic dynamical system describing growth dynamics of DNA template in a PCR model.

Date Issued
2014-08-18
Keywords
Experimental Design
•
POMDP
•
Diffusion processes
Committee Chair
Hooker, Giles J.
Committee Member
Turnbull, Bruce William
Booth, James
Degree Discipline
Statistics
Degree Name
Ph. D., Statistics
Degree Level
Doctor of Philosophy
Type
dissertation or thesis

Site Statistics | Help

About eCommons | Policies | Terms of use | Contact Us

copyright © 2002-2026 Cornell University Library | Privacy | Web Accessibility Assistance