The spatio-temporal characteristics and driving mechanisms of the Asian summer monsoon (ASM) during the early and middle Holocene remain unclear. Moreover, the timing of maximum monsoon precipitation in the Asian monsoon margin of northwest China during this period is also a subject of considerable debate. Herein, we analyzed phytolith assemblages within 55 calcareous root tube (CRT) samples from the hinterland of the Tengger Desert to quantitatively reconstruct Holocene millennial-scale precipitation changes and discuss the potential forcing mechanisms. Our results revealed that the mean annual precipitation (MAP) was 138 ± 53 to 149 ± 18 mm during 10.0–7.0 cal kyr BP, 179 ± 26 to 192 ± 26 mm during 7.0–5.0 cal kyr BP, and 129 ± 20 to 161 ± 13 mm during 5.0–1.0 cal kyr BP. The quantitative reconstruction results suggested that precipitation in this area was low in the early Holocene, then increased to a maximum in the middle Holocene (30% higher precipitation than present), and gradually decreased in the late Holocene. Maximum monsoon precipitation did not occur until the middle Holocene in this area because the northernmost margin of the ASM reached its northernmost latitude lagging behind its maximum monsoon intensity suppressed by high-northern latitude ice volume forcing during the early Holocene despite high summer insolation. In addition to quantifying the Holocene millennial-scale precipitation changes in the northwestern margin of the ASM, this study also provides new evidence for spatial and temporal variations of the ASM during the Holocene.