Cornell University
Library
Cornell UniversityLibrary

eCommons

Help
Log In(current)
  1. Home
  2. Cornell University Graduate School
  3. Cornell Theses and Dissertations
  4. AI ASSEMBLY: OBJECT RECOGNITION, COMPUTER VISION, AND DIGITAL TWIN FOR MIXED REALITY ASSEMBLY

AI ASSEMBLY: OBJECT RECOGNITION, COMPUTER VISION, AND DIGITAL TWIN FOR MIXED REALITY ASSEMBLY

File(s)
Ma_cornell_0058O_11808.pdf (16.75 MB)
Permanent Link(s)
https://doi.org/10.7298/ha3k-4e73
https://hdl.handle.net/1813/113919
Collections
Cornell Theses and Dissertations
Author
Ma, Haotian
Kyaw, Alexander Htet
Abstract

The thesis explores incorporating emerging computing technologies in architectural assembly and design processes, with a focus on developing an AI system for recognizing self-similar components and generating step-by-step assembly instructions. The proposed methodology includes the use of object recognition algorithms, computer vision, digital twins, and mixed reality. The thesis consists of a series of investigations, such as an initial prototypical study using Lego blocks, synthetic dataset generation, secondary case studies with 3D-printed nodes, real-time video streaming and processing, and assembly instruction generation. The AI-Assembly system can respond to real-time user changes, error detection, assembly status tracking, and structure analysis to support human creative agency during the design iteration process. The thesis aims to facilitate Human-AI co-creation in assembling complex structures, enhancing efficiency and flexibility in architectural processes. Furthermore, this research contributes to the growing field of architecture by demonstrating the potential of emerging technologies and integrating physical modeling processes.

Description
This paper submitted In partial fulfillment of the requirements for the degree of Master of Science in Advanced Architectural Studies (M.S.AAD) for H. Ma, and Bachelor of Architecture (B.Arch) for A.H. Kyaw.
Date Issued
2023-05
Committee Chair
Sabin, Jenny
Committee Member
Marschner, Stephen
Degree Discipline
Architecture
Degree Name
M.S., Architecture
Degree Level
Master of Science
Rights
Attribution-NonCommercial 4.0 International
Rights URI
https://creativecommons.org/licenses/by-nc/4.0/
Type
dissertation or thesis
Link(s) to Catalog Record
https://newcatalog.library.cornell.edu/catalog/16176564

Site Statistics | Help

About eCommons | Policies | Terms of use | Contact Us

copyright © 2002-2026 Cornell University Library | Privacy | Web Accessibility Assistance