Galaxies are known to change dramatically over cosmic time in terms of their star formation, masses, structure, and internal (chemical) properties. While single-wavelength studies in pencil-beam areas on sky provide some insights, multi-wavelength studies of the full galaxy population are crucial to understand galaxy evolution as a whole. In this talk, I present different aspects of galaxy evolution and the latest (and future) surveys that enable us to study them. The ALPINE survey with ALMA is one of the largest of such multi-wavelength surveys, combining UV to sub-mm observations of z=4-6 galaxies to study in detail the evolution of gas and dust during this early growth phase of galaxy evolution. ALPINE builds the basis sample and anchor for the comparison to surveys at lower and higher redshifts as well as to state-of-the-art simulations. Some of these galaxies may harbor accreting black holes and some may be on the verge of being quenched. With follow-up programs with existing (HST, JWST) and future (Euclid, Roman, SPHEREx) facilities, we will be able to study the beginning and fate of these galaxies.