<?xml version='1.0' encoding='UTF-8'?><?xml-stylesheet href='static/style.xsl' type='text/xsl'?><OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd"><responseDate>2026-11-22T11:13:59Z</responseDate><request verb="GetRecord" identifier="oai:ecommons.cornell.edu:1813/121033" metadataPrefix="dim">https://ecommons.cornell.edu/server/oai/request</request><GetRecord><record><header><identifier>oai:ecommons.cornell.edu:1813/121033</identifier><datestamp>2026-05-15T17:53:04Z</datestamp><setSpec>com_1813_35</setSpec><setSpec>col_1813_47</setSpec></header><metadata><dim:dim xmlns:dim="http://www.dspace.org/xmlns/dspace/dim" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:doc="http://www.lyncode.com/xoai" xsi:schemaLocation="http://www.dspace.org/xmlns/dspace/dim http://www.dspace.org/schema/dim.xsd">
   <dim:field mdschema="dc" element="contributor" qualifier="author">Paradise, Andre</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="chair" lang="en_US">Ferrari, Silvia</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="committeeMember" lang="en_US">Petersen, Kirstin</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="committeeMember" lang="en_US">Albertson, John</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="accessioned">2026-04-03T18:52:21Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="issued">2025-12</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="other">ProQuest Submission ID: 15323</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="other">ProQuest Publication ID: 32280853</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="uri">https://hdl.handle.net/1813/121033</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="doi">https://doi.org/10.7298/z88d-ry49</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="bibid">17423416</dim:field>
   <dim:field mdschema="dc" element="description" lang="en_US">119 pages</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="abstract" lang="en_US">Effective human-autonomy collaboration requires sophisticated testing environments and intelligent perception systems that respond in real time to dynamic situations. As autonomous robots become increasingly prevalent in society, their ability to understand complex scenes and interact naturally with human teammates becomes critical for applications ranging from search and rescue to healthcare and manufacturing. Current approaches face significant limitations: field testing lacks detailed ground truth for algorithm validation, while conventional perception systems operate without close coupling to the vehicle's motor control, introducing latency that hinders fluid interaction within human-autonomy teams. This dissertation addresses these challenges through two complementary research thrusts. The first contribution introduces the Real-Time Human Autonomous Systems Collaborations (RealTHASC) facility, a cyber-physical extended reality (XR) testbed that seamlessly interfaces real and virtual agents with photorealistic simulated environments. By integrating motion capture, wearable sensors, and virtual reality technologies, RealTHASC creates a unified framework where physical robots and humans interact with virtual agents through real-time feedback. Human subjects and robots in the laboratory space are transferred into synthetic environments as avatars that experience the virtual world through simulated sensors while maintaining kinematic coupling with their real counterparts. The second contribution presents a perception-in-action framework that enables robot-embodied visual understanding for real-time human-robot interaction. This event-driven approach integrates motor control and perception in a closed-loop system, allowing mobile robots to interact with nearby people using semantic labels and hand gestures while navigating complex environments. By coupling vision and feedback control designs, the system enables robots to respond to visual scenes through dynamic and autonomous functionalities, overcoming limitations of traditional computer vision techniques that rely on passive, open-loop processing. The framework exploits controlled camera motion to actively simplify visual perception tasks, creating a synergistic relationship between perception and action that enhances efficiency and responsiveness. Experimental results demonstrate effectiveness across diverse applications, with RealTHASC validated through case studies of mixed real/virtual interactions and the perception-in-action framework proving robust in challenging environments. Together, these advances provide a foundation for holistic scene understanding that facilitates natural, effective collaboration between humans and autonomous systems in complex scenarios.</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="embargo">2028-01-08</dim:field>
   <dim:field mdschema="dc" element="language" qualifier="iso">en</dim:field>
   <dim:field mdschema="dc" element="rights">Attribution 4.0 International</dim:field>
   <dim:field mdschema="dc" element="rights" qualifier="uri">https://creativecommons.org/licenses/by/4.0/</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en_US">Artificial Intelligence</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en_US">Human-Autonomy Teaming</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en_US">Human-Robot Interaction</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en_US">Robot Perception</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en_US">Robotics</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en_US">Virtual Reality</dim:field>
   <dim:field mdschema="dc" element="title" lang="en_US">Holistic Scene Understanding for Real-Time Human-Autonomy Systems Interaction and Teaming</dim:field>
   <dim:field mdschema="dc" element="type" lang="en_US">dissertation or thesis</dim:field>
   <dim:field mdschema="dc" element="format" qualifier="mimetype">application/pdf</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="discipline">Mechanical Engineering</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="grantor">Cornell University</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="level">Doctor of Philosophy</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="name">Ph. D., Mechanical Engineering</dim:field>
   <dim:field mdschema="dcterms" element="license">https://hdl.handle.net/1813/59810.2</dim:field>
   <dim:field mdschema="dspace" element="entity" qualifier="type">Publication</dim:field>
   <dim:field mdschema="cris" element="virtual" qualifier="collection" authority="https://ecommons.cornell.edu/handle/1813/47" confidence="600">Cornell Theses and Dissertations</dim:field>
   <dim:field mdschema="cris" element="virtual" qualifier="author">Paradise, Andre</dim:field>
   <dim:field mdschema="cris" element="virtualsource" qualifier="collection">5893a6ea-7af3-41d7-abc6-04bcd26ab5df</dim:field>
   <dim:field mdschema="others" element="access-status">embargo</dim:field>
   <dim:field mdschema="others" element="access-status">embargo</dim:field>
   <dim:field mdschema="cerif" element="openaire" authority="" confidence="-1">&lt;Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="48b7a9f4-b26e-44de-a8ae-7414a8b4901b">
	&lt;Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843&lt;/Type>
	&lt;Language>en&lt;/Language>
   	&lt;Title>Holistic Scene Understanding for Real-Time Human-Autonomy Systems Interaction and Teaming&lt;/Title>
   	&lt;PublishedIn>
    	&lt;Publication>
      	&lt;/Publication>
   	&lt;/PublishedIn>
   	&lt;PublicationDate>2025-12&lt;/PublicationDate>
   	&lt;DOI>https://doi.org/10.7298/z88d-ry49&lt;/DOI>
   	&lt;Authors>
      	&lt;Author>
        	&lt;DisplayName>Paradise, Andre&lt;/DisplayName>
         	&lt;Affiliation>
         		&lt;OrgUnit>
         		&lt;/OrgUnit>
         	&lt;/Affiliation>
      	&lt;/Author>
	&lt;/Authors>
   	&lt;Editors>
	&lt;/Editors>
    &lt;Publishers>
        &lt;Publisher>
            &lt;OrgUnit />
        &lt;/Publisher>
    &lt;/Publishers>
    &lt;License>https://creativecommons.org/licenses/by/4.0/&lt;/License>
    &lt;Keyword>Artificial Intelligence&lt;/Keyword>
    &lt;Keyword>Human-Autonomy Teaming&lt;/Keyword>
    &lt;Keyword>Human-Robot Interaction&lt;/Keyword>
    &lt;Keyword>Robot Perception&lt;/Keyword>
    &lt;Keyword>Robotics&lt;/Keyword>
    &lt;Keyword>Virtual Reality&lt;/Keyword>
   	&lt;Abstract>Effective human-autonomy collaboration requires sophisticated testing environments and intelligent perception systems that respond in real time to dynamic situations. As autonomous robots become increasingly prevalent in society, their ability to understand complex scenes and interact naturally with human teammates becomes critical for applications ranging from search and rescue to healthcare and manufacturing. Current approaches face significant limitations: field testing lacks detailed ground truth for algorithm validation, while conventional perception systems operate without close coupling to the vehicle&amp;apos;s motor control, introducing latency that hinders fluid interaction within human-autonomy teams. This dissertation addresses these challenges through two complementary research thrusts. The first contribution introduces the Real-Time Human Autonomous Systems Collaborations (RealTHASC) facility, a cyber-physical extended reality (XR) testbed that seamlessly interfaces real and virtual agents with photorealistic simulated environments. By integrating motion capture, wearable sensors, and virtual reality technologies, RealTHASC creates a unified framework where physical robots and humans interact with virtual agents through real-time feedback. Human subjects and robots in the laboratory space are transferred into synthetic environments as avatars that experience the virtual world through simulated sensors while maintaining kinematic coupling with their real counterparts. The second contribution presents a perception-in-action framework that enables robot-embodied visual understanding for real-time human-robot interaction. This event-driven approach integrates motor control and perception in a closed-loop system, allowing mobile robots to interact with nearby people using semantic labels and hand gestures while navigating complex environments. By coupling vision and feedback control designs, the system enables robots to respond to visual scenes through dynamic and autonomous functionalities, overcoming limitations of traditional computer vision techniques that rely on passive, open-loop processing. The framework exploits controlled camera motion to actively simplify visual perception tasks, creating a synergistic relationship between perception and action that enhances efficiency and responsiveness. Experimental results demonstrate effectiveness across diverse applications, with RealTHASC validated through case studies of mixed real/virtual interactions and the perception-in-action framework proving robust in challenging environments. Together, these advances provide a foundation for holistic scene understanding that facilitates natural, effective collaboration between humans and autonomous systems in complex scenarios.&lt;/Abstract>
	&lt;Access xmlns="http://purl.org/coar/access_right" 
    >
    &lt;/Access>
&lt;/Publication>
</dim:field>
</dim:dim>
</metadata></record></GetRecord></OAI-PMH>