Heavy metals in vegetables are of great concern worldwide due to their potential bioaccumulation in human. This review-based study researched the concentrations of heavy metals in vegetables from all provinces of China between 2004 and 2018, and assessed the health risk for the residents. The results displayed the highest Pb, Cd, Cu, and Zn concentrations in vegetables were 0.192 mg/kg (west area), 0.071 mg/kg (central area), 3.961 mg/kg (central area), and 10.545 mg/kg (central area), which were lower than the maximum allowable concentration. In the national scale, the weighted average level of heavy metals in vegetables was found to be in the order of Zn > Cu > Pb > Cd. The hazard index (HI) of each province showed that beside Anhui and Hunan province, residents in other provinces of China faced a low high risk of Pb, Cd, Cu, and Zn. However, people consuming vegetables faced a high risk of Pb, Cd, Cu, and Zn in Anhui and Hunan provinces. This research may provide insight into heavy metal accumulation in vegetables and forecast to residents to cope with these problems for improved human health.