Maps are available for various types of environments. Most people can easily read maps and localize themselves. In this thesis we address this problem: Can computer algorithms make use of the map information, and effectively make associations between vision inputs provided by the camera and map clues, to localize the camera? To be specific, we focus on three different scenarios: outdoor localization, vehicle localization, and indoor localization.