Interactions between a learner and an environment arise in a variety of domains, ranging from online recommendations (e.g., Spotify) to control of physical dynamical systems (e.g., temperature regulation in a datacenter). In this dissertation we study such problems through two different perspectives: online decision-making and network science. In Part I we study how a learner should make decisions