With the rapid development of society, the improvement of material level and the current situation of the large-scale population flow in China, the awareness of security is becoming more and more important in people’s life. With the rapid development of image processing and computer vision technology, people try to analyze, process and understand the collected video image automatically without human intervention. The intelligent video monitoring system collects video signals of interested objects in a dynamic scene through a camera, and processes and analyzes image information by a computer. Only by establishing a reasonable and effective urban video monitoring management system can government departments find out problems in the first time. The traditional highway monitoring and commanding traffic scheduling system based on GIS, which can obtain road traffic information and conduct traffic scheduling by remote sensing, has the disadvantage of poor effect on traffic scheduling. In this paper, real-time communication technology and computer vision acquisition technology are used to build a city monitoring system. The experimental results show that this method has strong timeliness and good monitoring effect. Compared with the state-of-the-art methodologies, the proposed framework is efficient and accurate.