The slower response speed is the main problem in the application of ZnO quantum dots (QDs) photodetector, which has been commonly attributed to the presence of excess oxygen vacancy defects and oxygen adsorption/desorption processes. However, the detailed mechanism is still not very clear. Herein, the properties of ZnO QDs and their photodetectors with different amounts of oxygen vacancy (V_O) defects controlled by hydrogen peroxide (H₂O₂) solution treatment have been investigated. After H₂O₂ solution treatment, V_O concentration of ZnO QDs decreased. The H₂O₂ solution-treated device has a higher photocurrent and a lower dark current. Meanwhile, with the increase in V_O concentration of ZnO QDs, the response speed of the device has been improved due to the increase of oxygen adsorption/desorption rate. More interestingly, the response speed of the device became less sensitive to temperature and oxygen concentration with the increase of V_O defects. The findings in this work clarify that the surface V_O defects of ZnO QDs could enhance the photoresponse speed, which is helpful for sensor designing.