Understanding the formation and evolution of galaxies from the Big Bang to the present day is one of the most important questions in modern astronomy. The tremendous amount of observational data accumulated in the past decade that probe various properties of galaxies across cosmic time demand a more detailed theoretical understanding of galaxy formation and evolution. In this thesis, I will investigate several open question in this field using state-of-the-art cosmological hydrodynamic zoom-in simulations of galaxy formation from the Feedback in Realistic Environments (FIRE) suite. These high-resolution simulations (10-104M⊙, 0.1-10pc) include realistic models of the multi-phase ISM, star formation, and stellar feedback and explicitly ca...