Tracing the growth of Milky Way-like galaxies