Orchestrating Inter-Datacenter Bulk Transfers with CodedBulk
| dc.contributor.author | Tseng, Shih-Hao | |
| dc.contributor.chair | Tang, Ao | |
| dc.contributor.committeeMember | Tong, Lang | |
| dc.contributor.committeeMember | Bitar, Eilyan Yamen | |
| dc.date.accessioned | 2019-04-02T14:00:27Z | |
| dc.date.available | 2019-04-02T14:00:27Z | |
| dc.date.issued | 2018-12-30 | |
| dc.description.abstract | Over the past decades, data centers are built across the globe in response to the ever-growing Internet traffic. The data centers are managed and operated by the service providers through private inter-datacenter wide area networks (WANs). Unlike WANs involving multiple service providers, these private inter-datacenter WANs exhibit a number of unique characteristics. For example, the end-hosts and the network fabric are controlled by one single provider; scheduled bulk traffic transfers terabits of data across expensive WAN links for replication and migration; also, major service providers embrace software-defined networking (SDN) in their inter-datacenter WANs for easier management and better performance. These unique characteristics enable new solutions that were either infeasible or impractical in traditional WANs. We present CodedBulk, an end-to-end system that reduces the bandwidth required for inter-datacenter bulk transfers. CodedBulk is rooted in a known technique from the information theory community -- network coding. Network coding has been known not only for its significant theoretical benefits but also for its challenging real-world implementation and adoption. CodedBulk addresses the technical implementation challenges of network coding by exploiting the unique characteristics of inter-datacenter bulk transfers. The design of CodedBulk is agnostic to the underlying transport layer, which allows smooth integration into existing infrastructure. We run our system prototype on inter-datacenter networks, and it demonstrates a significant throughput improvement resulting from the bandwidth reduction. | |
| dc.identifier.doi | https://doi.org/10.7298/jj8a-b548 | |
| dc.identifier.other | Tseng_cornellgrad_0058F_11142 | |
| dc.identifier.other | http://dissertations.umi.com/cornellgrad:11142 | |
| dc.identifier.other | bibid: 10758041 | |
| dc.identifier.uri | https://hdl.handle.net/1813/64901 | |
| dc.language.iso | en_US | |
| dc.rights | Attribution-ShareAlike 4.0 International | |
| dc.rights.uri | https://creativecommons.org/licenses/by-sa/4.0/ | |
| dc.subject | Computer science | |
| dc.subject | Inter-Datacenter Network | |
| dc.subject | Network Coding | |
| dc.subject | Computer engineering | |
| dc.title | Orchestrating Inter-Datacenter Bulk Transfers with CodedBulk | |
| dc.type | dissertation or thesis | |
| dcterms.license | https://hdl.handle.net/1813/59810 | |
| thesis.degree.discipline | Electrical and Computer Engineering | |
| thesis.degree.grantor | Cornell University | |
| thesis.degree.level | Doctor of Philosophy | |
| thesis.degree.name | Ph. D., Electrical and Computer Engineering |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- Tseng_cornellgrad_0058F_11142.pdf
- Size:
- 1.28 MB
- Format:
- Adobe Portable Document Format