Holistic Optimization of Embedded Computer Vision Systems

dc.contributor.authorBuckler, Mark Andrew
dc.contributor.chairSampson, Adrian L
dc.contributor.committeeMemberBatten, Christopher
dc.contributor.committeeMemberHariharan, Bharath
dc.contributor.committeeMemberDe Sa, Christopher Matthew
dc.date.accessioned2019-10-15T16:48:52Z
dc.date.available2019-10-15T16:48:52Z
dc.date.issued2019-08-30
dc.description.abstractDespite strong interest in embedded computer vision, the computational demands of Convolutional Neural Network (CNN) inference far exceed the resources available in embedded devices. Thankfully, the typical embedded device has a number of desirable properties that can be leveraged to significantly reduce the time and energy required for CNN inference. This thesis presents three independent and synergistic methods for optimizing embedded computer vision: 1) Reducing the time and energy needed to capture and preprocess input images by optimizing the image capture pipeline for the needs of CNNs rather than humans. 2) Exploiting temporal redundancy within incoming video streams to perform computationally cheap motion estimation and compensation in lieu of full CNN inference for the majority of frames. 3) Leveraging the sparsity of CNN activations within the frequency domain to significantly reduce the number of operations needed for inference. Collectively these techniques significantly reduce the time and energy needed for computer vision at the edge, enabling a wide variety of exciting new applications.
dc.identifier.doihttps://doi.org/10.7298/tcy7-vx76
dc.identifier.otherBuckler_cornellgrad_0058F_11723
dc.identifier.otherhttp://dissertations.umi.com/cornellgrad:11723
dc.identifier.otherbibid: 11050597
dc.identifier.urihttps://hdl.handle.net/1813/67614
dc.language.isoen_US
dc.subjectComputer engineering
dc.subjectcomputer vision
dc.subjectConvolutional Neural Networks
dc.subjectEmbedded Systems
dc.subjectComputer science
dc.subjectImaging
dc.titleHolistic Optimization of Embedded Computer Vision Systems
dc.typedissertation or thesis
dcterms.licensehttps://hdl.handle.net/1813/59810
thesis.degree.disciplineElectrical and Computer Engineering
thesis.degree.grantorCornell University
thesis.degree.levelDoctor of Philosophy
thesis.degree.namePh.D., Electrical and Computer Engineering
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Buckler_cornellgrad_0058F_11723.pdf
Size:
4.22 MB
Format:
Adobe Portable Document Format