Cornell University
Library
Cornell UniversityLibrary

eCommons

Help
Log In(current)
  1. Home
  2. Cornell University Graduate School
  3. Cornell Theses and Dissertations
  4. Towards Mixed-Initiative Machines for Creative Tasks

Towards Mixed-Initiative Machines for Creative Tasks

File(s)
Bremers_cornellgrad_0058F_15525.pdf (67.63 MB)
Permanent Link(s)
https://doi.org/10.7298/fhzw-k240
https://hdl.handle.net/1813/126665
Collections
Cornell Theses and Dissertations
Author
Bremers, Alexandra
Abstract

Fabrication machines are becoming more capable, yet most still operate as passive tools that wait for explicit commands. This dissertation investigates how fabrication machines might instead take initiative to support creative making, without automating away the enjoyment of the process. The central question is how to design machine initiative that is helpful and timely while preserving human agency, skill development, and the intrinsic satisfactions of craft. The research proceeds in three parts. First, theoretical foundations are established, drawing on Sennett's analysis of craftsmanship, Schön's concept of reflective practice, and Horvitz's principles for mixed-initiative interaction. These foundations are then grounded in empirical understanding through interviews with maker entrepreneurs, observations of professional machine operators, and design explorations illustrating the design space for collaborative fabrication. Second, methods are developed for observing and capturing the multi-modal interactions that occur around fabrication machines. Through a study of 12 participants interacting with three tabletop machines (a clay extruder, a pen plotter, and a sewing machine), it is demonstrated that a minimal combination of egocentric and machine-mounted cameras captures the majority of relevant interaction information, and an instrumentation protocol is proposed. In the resulting FabriCam-5 dataset, implicit behavioral cues, such as hesitation, postural shifts, and gaze changes, are observed to precede explicit help-seeking, suggesting that machines attending to these signals could intervene before makers reach the point of frustration. Third, this premise is tested through a Wizard-of-Oz study comparing proactive and reactive machine assistance during a sewing task with 20 novice participants, resulting in the CoSew-4 dataset. Proactive assistance, in which the machine anticipated confusion based on behavioral cues and task stage, was perceived as significantly more timely than reactive assistance, with a large effect size, without increasing perceived annoyance. Proactive assistance also trended toward higher helpfulness ratings. These subjective differences appeared despite no measurable effect on task performance, suggesting that user experience measures may be more informative than efficiency metrics for evaluating co-creative systems. Study participants engaged socially with the machine and anticipated that their preferences for assistance would change as expertise developed. This dissertation contributes: (1) resources for studying mixed-initiative interactions in creative tasks, including instrumentation methods, protocols, and two synchronized multi-view video datasets (FabriCam-5 and CoSew-4); (2) empirical evidence that proactive machine assistance improves novice makers' experience without undermining their engagement; and (3) design principles for mixed-initiative fabrication systems that balance technical support with the preservation of creative agency. Together, these contributions lay the groundwork that is required for the design and development of mixed-initiative machines for creative tasks.

Description
224 pages
Date Issued
2026-05
Keywords
design research
•
fabrication
•
human-computer interaction
•
human-robot interaction
•
mixed-initiative interaction
•
proactive assistance
Committee Chair
Ju, Wendy
Committee Member
Marschner, Stephen
Guimbretiere, Francois
Degree Discipline
Information Science
Degree Name
Ph. D., Information Science
Degree Level
Doctor of Philosophy
Type
dissertation or thesis

Site Statistics | Help

About eCommons | Policies | Terms of use | Contact Us

copyright © 2002-2026 Cornell University Library | Privacy | Web Accessibility Assistance