<?xml version='1.0' encoding='UTF-8'?><?xml-stylesheet href='static/style.xsl' type='text/xsl'?><OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd"><responseDate>2026-11-22T11:16:33Z</responseDate><request verb="GetRecord" identifier="oai:ecommons.cornell.edu:1813/111727" metadataPrefix="dim">https://ecommons.cornell.edu/server/oai/request</request><GetRecord><record><header><identifier>oai:ecommons.cornell.edu:1813/111727</identifier><datestamp>2026-05-15T19:44:30Z</datestamp><setSpec>com_1813_35</setSpec><setSpec>col_1813_47</setSpec></header><metadata><dim:dim xmlns:dim="http://www.dspace.org/xmlns/dspace/dim" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:doc="http://www.lyncode.com/xoai" xsi:schemaLocation="http://www.dspace.org/xmlns/dspace/dim http://www.dspace.org/schema/dim.xsd">
   <dim:field mdschema="dc" element="contributor" qualifier="author">Keane, Ronan</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="chair">Gao, H. Oliver</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="committeeMember">Rand, Richard Herbert</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="committeeMember">Pender, Jamol J.</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="committeeMember">Samaranayake, Samitha</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="accessioned">2022-09-15T15:51:02Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="available">2022-09-15T15:51:02Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="issued">2022-05</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="other">ProQuest Submission ID: 12997</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="other">ProQuest Publication ID: 29164848</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="uri">https://hdl.handle.net/1813/111727</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="doi">https://doi.org/10.7298/pjz7-ef27</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="bibid">15529961</dim:field>
   <dim:field mdschema="dc" element="description">237 pages</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="abstract">It seems that in the current age, computers, computation, and data have an increasingly important role to play in scientific research and discovery. This is reflected in part by the rise of machine learning and artificial intelligence, which have become great areas of interest not just for computer science but also for many other fields of study. More generally, there have been trends moving towards the use of bigger, more complex and higher capacity models. It also seems that stochastic models, and stochastic variants of existing deterministic models, have become important research directions in various fields. For all of these types of models, gradient-based optimization remains as the dominant paradigm for model fitting, control, and more. This dissertation considers unconstrained, nonlinear optimization problems, with a focus on the gradient itself, that key quantity which enables the solution of such problems. In chapter 1, we introduce the notion of reverse differentiation, a term which describes the body of techniques which enables the efficient computation of gradients. We cover relevant techniques both in the deterministic and stochastic cases. We present a new framework for calculating the gradient of problems which involve both deterministic and stochastic elements. The resulting gradient estimator can be applied in virtually any situation (including many where automatic differentiation alone fails due to the fact that it does not give gradient terms due to score functions). In chapter 2, we analyze the properties of the gradient estimator, with a focus on those properties which are typically assumed in convergence proofs of optimization algorithms. That chapter attempts to bridge some of the gap between what is assumed in a mathematical optimization proof, and what we need to prove to get a convergence result for a specific model/problem formulation. Chapter 3 gives various examples of applying our new gradient estimator. We further explore the idea of working with piecewise continuous models, that is, models with distinct branches and if statements which define what specific branch to use. We also discuss model elements that cause problems in gradient-based optimization, and how to reformulate a model to avoid such issues. Lastly, chapter 4 presents a new optimal baseline for use in the variance reduction of gradient estimators involving score functions. We forsee that methodology as becoming a key part of gradient estimation, as the presence of score functions is a key feature in our gradient estimator. In somewhat of a departure from the previous chapters, chapters 5 and 6 present two studies in transportation, one of the core emerging application areas which have motivated this dissertation.</dim:field>
   <dim:field mdschema="dc" element="language" qualifier="iso">en</dim:field>
   <dim:field mdschema="dc" element="rights">Attribution 4.0 International</dim:field>
   <dim:field mdschema="dc" element="rights" qualifier="uri">https://creativecommons.org/licenses/by/4.0/</dim:field>
   <dim:field mdschema="dc" element="subject">automatic differentiation</dim:field>
   <dim:field mdschema="dc" element="subject">baselines</dim:field>
   <dim:field mdschema="dc" element="subject">gradient estimation</dim:field>
   <dim:field mdschema="dc" element="subject">gradient-based optimization</dim:field>
   <dim:field mdschema="dc" element="subject">score functions</dim:field>
   <dim:field mdschema="dc" element="subject">stochastic gradient</dim:field>
   <dim:field mdschema="dc" element="title">Gradient Estimation and Variance Reduction in Stochastic and Deterministic Models</dim:field>
   <dim:field mdschema="dc" element="type">dissertation or thesis</dim:field>
   <dim:field mdschema="dc" element="relation" qualifier="localuri">https://newcatalog.library.cornell.edu/catalog/15529961</dim:field>
   <dim:field mdschema="dc" element="format" qualifier="mimetype">application/pdf</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="discipline">Systems Engineering</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="grantor">Cornell University</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="level">Doctor of Philosophy</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="name">Ph. D., Systems Engineering</dim:field>
   <dim:field mdschema="dcterms" element="license">https://hdl.handle.net/1813/59810.2</dim:field>
   <dim:field mdschema="dspace" element="entity" qualifier="type">Publication</dim:field>
   <dim:field mdschema="cris" element="virtual" qualifier="collection" authority="https://cornell-ecommons.eks.prod.4science.cloud/handle/1813/47" confidence="600">Cornell Theses and Dissertations</dim:field>
   <dim:field mdschema="cris" element="virtual" qualifier="author">Keane, Ronan</dim:field>
   <dim:field mdschema="cris" element="virtualsource" qualifier="collection">5893a6ea-7af3-41d7-abc6-04bcd26ab5df</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
   <dim:field mdschema="cerif" element="openaire" authority="" confidence="-1">&lt;Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="f050d74f-31e7-4fe3-9f33-1b3af7ba3888">
	&lt;Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843&lt;/Type>
	&lt;Language>en&lt;/Language>
   	&lt;Title>Gradient Estimation and Variance Reduction in Stochastic and Deterministic Models&lt;/Title>
   	&lt;PublishedIn>
    	&lt;Publication>
      	&lt;/Publication>
   	&lt;/PublishedIn>
   	&lt;PublicationDate>2022-05&lt;/PublicationDate>
   	&lt;DOI>https://doi.org/10.7298/pjz7-ef27&lt;/DOI>
   	&lt;Authors>
      	&lt;Author>
        	&lt;DisplayName>Keane, Ronan&lt;/DisplayName>
         	&lt;Affiliation>
         		&lt;OrgUnit>
         		&lt;/OrgUnit>
         	&lt;/Affiliation>
      	&lt;/Author>
	&lt;/Authors>
   	&lt;Editors>
	&lt;/Editors>
    &lt;Publishers>
        &lt;Publisher>
            &lt;OrgUnit />
        &lt;/Publisher>
    &lt;/Publishers>
    &lt;License>https://creativecommons.org/licenses/by/4.0/&lt;/License>
    &lt;Keyword>automatic differentiation&lt;/Keyword>
    &lt;Keyword>baselines&lt;/Keyword>
    &lt;Keyword>gradient estimation&lt;/Keyword>
    &lt;Keyword>gradient-based optimization&lt;/Keyword>
    &lt;Keyword>score functions&lt;/Keyword>
    &lt;Keyword>stochastic gradient&lt;/Keyword>
   	&lt;Abstract>It seems that in the current age, computers, computation, and data have an increasingly important role to play in scientific research and discovery. This is reflected in part by the rise of machine learning and artificial intelligence, which have become great areas of interest not just for computer science but also for many other fields of study. More generally, there have been trends moving towards the use of bigger, more complex and higher capacity models. It also seems that stochastic models, and stochastic variants of existing deterministic models, have become important research directions in various fields. For all of these types of models, gradient-based optimization remains as the dominant paradigm for model fitting, control, and more. This dissertation considers unconstrained, nonlinear optimization problems, with a focus on the gradient itself, that key quantity which enables the solution of such problems. In chapter 1, we introduce the notion of reverse differentiation, a term which describes the body of techniques which enables the efficient computation of gradients. We cover relevant techniques both in the deterministic and stochastic cases. We present a new framework for calculating the gradient of problems which involve both deterministic and stochastic elements. The resulting gradient estimator can be applied in virtually any situation (including many where automatic differentiation alone fails due to the fact that it does not give gradient terms due to score functions). In chapter 2, we analyze the properties of the gradient estimator, with a focus on those properties which are typically assumed in convergence proofs of optimization algorithms. That chapter attempts to bridge some of the gap between what is assumed in a mathematical optimization proof, and what we need to prove to get a convergence result for a specific model/problem formulation. Chapter 3 gives various examples of applying our new gradient estimator. We further explore the idea of working with piecewise continuous models, that is, models with distinct branches and if statements which define what specific branch to use. We also discuss model elements that cause problems in gradient-based optimization, and how to reformulate a model to avoid such issues. Lastly, chapter 4 presents a new optimal baseline for use in the variance reduction of gradient estimators involving score functions. We forsee that methodology as becoming a key part of gradient estimation, as the presence of score functions is a key feature in our gradient estimator. In somewhat of a departure from the previous chapters, chapters 5 and 6 present two studies in transportation, one of the core emerging application areas which have motivated this dissertation.&lt;/Abstract>
	&lt;Access xmlns="http://purl.org/coar/access_right" 
    >
    &lt;/Access>
&lt;/Publication>
</dim:field>
</dim:dim>
</metadata></record></GetRecord></OAI-PMH>