Cornell University
Library
Cornell UniversityLibrary

eCommons

Help
Log In(current)
  1. Home
  2. Cornell University Graduate School
  3. Cornell Theses and Dissertations
  4. Algorithmic techniques for optimal collective communication

Algorithmic techniques for optimal collective communication

File(s)
Shapley_cornellgrad_0058F_15258.pdf (485.75 KB)
Permanent Link(s)
https://doi.org/10.7298/g77t-xv62
https://hdl.handle.net/1813/120754
Collections
Cornell Theses and Dissertations
Author
Shapley, Richard
Abstract

Improving the performance of collective communication---algorithms for coordinated data movement in distributed computing---becomes increasingly important as the use of large-scale machine learning clusters continues to grow. In this work, we introduce techniques for synthesizing optimal algorithms for collective communication for any given host and network topology. We provide a novel multicommodity flow-based approach that allows us to find provably optimal algorithms in terms of both latency and bandwidth utilization. Critical to our techniques are two important innovations: a conversion method from fluid solutions to discrete step-based solutions, and Mirrored Dantzig-Wolfe, which exploits the high degree of symmetry often present in communication networks. We complement our theoretical contributions with experimental results, demonstrating the practical efficacy of the constructed algorithms.

Description
116 pages
Date Issued
2025-08
Keywords
Collective Communication
•
Linear Programming
•
Multicommodity Flow
•
Optimization
Committee Chair
Shmoys, David
Committee Member
Banerjee, Siddhartha
Williamson, David
Degree Discipline
Operations Research and Information Engineering
Degree Name
Ph. D., Operations Research and Information Engineering
Degree Level
Doctor of Philosophy
Rights
Attribution 4.0 International
Rights URI
https://creativecommons.org/licenses/by/4.0/
Type
dissertation or thesis

Site Statistics | Help

About eCommons | Policies | Terms of use | Contact Us

copyright © 2002-2026 Cornell University Library | Privacy | Web Accessibility Assistance