<?xml version='1.0' encoding='UTF-8'?><?xml-stylesheet href='static/style.xsl' type='text/xsl'?><OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd"><responseDate>2026-11-22T10:17:35Z</responseDate><request verb="GetRecord" identifier="oai:ecommons.cornell.edu:1813/126519" metadataPrefix="dim">https://ecommons.cornell.edu/server/oai/request</request><GetRecord><record><header><identifier>oai:ecommons.cornell.edu:1813/126519</identifier><datestamp>2026-08-27T03:17:42Z</datestamp><setSpec>com_1813_35</setSpec><setSpec>col_1813_47</setSpec></header><metadata><dim:dim xmlns:dim="http://www.dspace.org/xmlns/dspace/dim" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:doc="http://www.lyncode.com/xoai" xsi:schemaLocation="http://www.dspace.org/xmlns/dspace/dim http://www.dspace.org/schema/dim.xsd">
   <dim:field mdschema="dc" element="contributor" qualifier="author">Tseng, Albert</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="chair" lang="en_US">De Sa, Christopher</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="committeeMember" lang="en_US">Bindel, David</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="committeeMember" lang="en_US">Ellis, Kevin</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="accessioned">2026-08-26T19:50:19Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="available">2026-08-26T19:50:19Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="issued">2026-05</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="other">Tseng_cornellgrad_0058F_15467</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="other">https://www.proquest.com/LegacyDocView/DISSNUM/32574126</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="uri">https://hdl.handle.net/1813/126519</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="doi">https://doi.org/10.7298/vqp3-4b34</dim:field>
   <dim:field mdschema="dc" element="description" lang="en_US">276 pages</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="abstract" lang="en_US">One overarching theme of the past decade of machine learning is that scaling any of the many axes of modeling generally improves model quality. By increasing data, compute, or the number of parameters, we can usually expect improvements in downstream performance. To the casual observer, it may seem that large, unstructured models are the key to deep learning. However, careful analysis shows that modern models are actually rich in structure. In this thesis, I show that it is possible to exploit these structures to improve the efficiency of deep models. In Part 2, I demonstrate that by using the geometric properties of Hyperbolic space to model hierarchies in attention mechanisms, we can significantly improve modeling performance on hierarchical data. In Part 3, I consider the problem of LLM quantization. I first show that by taking advantage of both the geometric structure of the model weights as well as the model loss landscape, we can compress models to as little as 1/8 of their original size without catastrophic loss of fidelity. Then, I apply these concepts to low-precision training, where I introduce the first near-lossless FP4 LLM training recipe, accelerating training by over 2x. Finally, in Part 4, I explore explicitly embedding structure into models with sparse embedding tables, resulting in more performant and faster structured sparse models. Many of these findings have been adopted in industry, confirming that even in the age of scaling, structural information is crucial for efficient learning.</dim:field>
   <dim:field mdschema="dc" element="language" qualifier="iso">en</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en_US">Efficiency</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en_US">Learning Systems</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en_US">Machine Learning</dim:field>
   <dim:field mdschema="dc" element="title" lang="en_US">Scaling the Efficiency of Large-Scale Learning with Structured Representations</dim:field>
   <dim:field mdschema="dc" element="type" lang="en_US">dissertation or thesis</dim:field>
   <dim:field mdschema="dc" element="format" qualifier="mimetype">application/pdf</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="discipline">Computer Science</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="grantor">Cornell University</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="level">Doctor of Philosophy</dim:field>
   <dim:field mdschema="thesis" element="degree" qualifier="name">Ph. D., Computer Science</dim:field>
   <dim:field mdschema="dcterms" element="license">https://hdl.handle.net/1813/59810.2</dim:field>
   <dim:field mdschema="dspace" element="entity" qualifier="type">Publication</dim:field>
   <dim:field mdschema="cris" element="virtual" qualifier="collection" authority="https://ecommons.cornell.edu/handle/1813/47" confidence="600">Cornell Theses and Dissertations</dim:field>
   <dim:field mdschema="cris" element="virtual" qualifier="author">Tseng, Albert</dim:field>
   <dim:field mdschema="cris" element="virtualsource" qualifier="collection">5893a6ea-7af3-41d7-abc6-04bcd26ab5df</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
   <dim:field mdschema="cerif" element="openaire" authority="" confidence="-1">&lt;Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="dc13e71f-9900-443b-88a2-0e1b5646c0a8">
	&lt;Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843&lt;/Type>
	&lt;Language>en&lt;/Language>
   	&lt;Title>Scaling the Efficiency of Large-Scale Learning with Structured Representations&lt;/Title>
   	&lt;PublishedIn>
    	&lt;Publication>
      	&lt;/Publication>
   	&lt;/PublishedIn>
   	&lt;PublicationDate>2026-05&lt;/PublicationDate>
   	&lt;DOI>https://doi.org/10.7298/vqp3-4b34&lt;/DOI>
   	&lt;Authors>
      	&lt;Author>
        	&lt;DisplayName>Tseng, Albert&lt;/DisplayName>
         	&lt;Affiliation>
         		&lt;OrgUnit>
         		&lt;/OrgUnit>
         	&lt;/Affiliation>
      	&lt;/Author>
	&lt;/Authors>
   	&lt;Editors>
	&lt;/Editors>
    &lt;Publishers>
        &lt;Publisher>
            &lt;OrgUnit />
        &lt;/Publisher>
    &lt;/Publishers>
    &lt;Keyword>Efficiency&lt;/Keyword>
    &lt;Keyword>Learning Systems&lt;/Keyword>
    &lt;Keyword>Machine Learning&lt;/Keyword>
   	&lt;Abstract>One overarching theme of the past decade of machine learning is that scaling any of the many axes of modeling generally improves model quality. By increasing data, compute, or the number of parameters, we can usually expect improvements in downstream performance. To the casual observer, it may seem that large, unstructured models are the key to deep learning. However, careful analysis shows that modern models are actually rich in structure. In this thesis, I show that it is possible to exploit these structures to improve the efficiency of deep models. In Part 2, I demonstrate that by using the geometric properties of Hyperbolic space to model hierarchies in attention mechanisms, we can significantly improve modeling performance on hierarchical data. In Part 3, I consider the problem of LLM quantization. I first show that by taking advantage of both the geometric structure of the model weights as well as the model loss landscape, we can compress models to as little as 1/8 of their original size without catastrophic loss of fidelity. Then, I apply these concepts to low-precision training, where I introduce the first near-lossless FP4 LLM training recipe, accelerating training by over 2x. Finally, in Part 4, I explore explicitly embedding structure into models with sparse embedding tables, resulting in more performant and faster structured sparse models. Many of these findings have been adopted in industry, confirming that even in the age of scaling, structural information is crucial for efficient learning.&lt;/Abstract>
	&lt;Access xmlns="http://purl.org/coar/access_right" 
    >
    &lt;/Access>
&lt;/Publication>
</dim:field>
</dim:dim>
</metadata></record></GetRecord></OAI-PMH>