East Asia, geographically extending to the Pamir Plateau in the west, to the Himalayan Mountains in the southwest, to Lake Baikal in the north and to the South China Sea in the south, harbors a variety of people, cultures, and languages. To reconstruct the natural history of East Asians is a mission of multiple disciplines, including genetics, archaeology, linguistics, and ethnology. Geneticists confirm the recent African origin of modern East Asians. Anatomically modern humans arose in Africa and immigrated into East Asia via a southern route approximately 50,000 years ago. Following the end of the Last Glacial Maximum approximately 12,000 years ago, rice and millet were domesticated in the south and north of East Asia, respectively, which allowed human populations to expand and linguistic families and ethnic groups to develop. These Neolithic populations produced a strong relation between the present genetic structures and linguistic families. The expansion of the Hongshan people from northeastern China relocated most of the ethnic populations on a large scale approximately 5300 years ago. Most of the ethnic groups migrated to remote regions, producing genetic structure differences between the edge and center of East Asia. In central China, pronounced population admixture occurred and accelerated over time, which subsequently formed the Han Chinese population and eventually the Chinese civilization. Population migration between the north and the south throughout history has left a smooth gradient in north–south changes in genetic structure. Observation of the process of shaping the genetic structure of East Asians may help in understanding the global natural history of modern humans.