Cornell University
Library
Cornell UniversityLibrary

eCommons

Help
Log In(current)
  1. Home
  2. Cornell University Graduate School
  3. Cornell Theses and Dissertations
  4. Optimally Navigating a Piecewise-deterministic World

Optimally Navigating a Piecewise-deterministic World

File(s)
Gee_cornellgrad_0058F_14450.pdf (21.89 MB)
Permanent Link(s)
https://doi.org/10.7298/68sq-ch97
https://hdl.handle.net/1813/116454
Collections
Cornell Theses and Dissertations
Author
Gee, Marissa
Abstract

We consider various problems arising in optimal control of piecewise-deterministic Markov processes (PDMPs), with an emphasis on path planning problems where a randomly switching mode impacts the dynamics and optimization objective. We introduce two application-driven modeling frameworks, each formulated as a piecewise-deterministic path planning problem. The first framework models a vehicle that may experience breakdowns of varying severity at random times as it navigates a domain. We present an efficient iterative solver to recover the mode-dependent value functions and optimal policies for this problem. The second proposes a model of optimal foraging in a continuous domain while subject to predation. We present numerical experiments to demonstrate the impact of a forager's objective on the predicted optimal behavior. We close by studying a class of "occasionally observed" PDMPs, in which the planner is not notified when a mode switch occurs, but may occasionally have access to observations of the current mode. We state sufficient assumptions under which it is possible to represent the resulting belief over the modes as an explicit function of time. We present efficient dynamic programming algorithms for computing value functions and optimal policies for a variety of horizon types and observation schemes.

Description
155 pages
Date Issued
2024-08
Keywords
Numerical Analysis
•
Optimal Control
•
Path Planning
•
Switched Systems
Committee Chair
Vladimirsky, Alexander
Committee Member
Damle, Anil
Strogatz, Steven
Ellner, Stephen
Degree Discipline
Applied Mathematics
Degree Name
Ph. D., Applied Mathematics
Degree Level
Doctor of Philosophy
Rights
Attribution-NonCommercial-ShareAlike 4.0 International
Rights URI
https://creativecommons.org/licenses/by-nc-sa/4.0/
Type
dissertation or thesis
Link(s) to Catalog Record
https://newcatalog.library.cornell.edu/catalog/16611674

Site Statistics | Help

About eCommons | Policies | Terms of use | Contact Us

copyright © 2002-2026 Cornell University Library | Privacy | Web Accessibility Assistance