GNSS World of China

Volume 46 Issue 1
Feb.  2021
Turn off MathJax
Article Contents
LI Wenguo, HUANG Liang, ZUO Xiaoqing, WANG Yizhu. A street view image change detection method combining semantic segmentation model and graph cuts[J]. GNSS World of China, 2021, 46(1): 98-104. doi: 10.12265/j.gnss.2020110401
Citation: LI Wenguo, HUANG Liang, ZUO Xiaoqing, WANG Yizhu. A street view image change detection method combining semantic segmentation model and graph cuts[J]. GNSS World of China, 2021, 46(1): 98-104. doi: 10.12265/j.gnss.2020110401

A street view image change detection method combining semantic segmentation model and graph cuts

doi: 10.12265/j.gnss.2020110401
  • Received Date: 2020-11-04
    Available Online: 2021-04-06
  • Publish Date: 2021-02-15
  • Due to the problems of the diversity of the scale, the unclear boundary and the complex spectral information of the ground objects, the performance of the statistical method and machine learning method for the change detection of the high complexity street view images is poor. Therefore, a street view images change detection method combining semantic segmentation model and graph cuts (GC) is proposed in this paper. Firstly, the DeeplabV3+ semantic segmentation model combined with migration learning is used to pre-train the Camvid data set to obtain the pre-trained model in this method; Then a small number of annotated samples from the data set of this paper were used to Fine Tune the pre-training model, which was respectively used for semantic segmentation of street view images in two periods. Then GC method is used to remove the sky, roads,vegetation and other factors, which is impacting on the street view. Finally, change vector analysis (CVA) is used to obtain the difference images, and binarization and accuracy evaluation were carried out for the difference images. The results show that the overall accuracy of the proposed method is better than the Otsu method (OTSU), K-means method, Segnet network migration learning method and DeeplabV3+ network migration learning method, it is a feasible method for detecting changes in street view images.

     

  • loading
  • [1]
    WU C, ZHANG L F, ZHANG L P. A scene change detection framework for multi-temporal very high resolution remote sensing images[J]. Signal processing, 2016, 124(sl): 184-197. DOI: 10.1016/j.sigpro.2015.09.020.
    [2]
    WU C, ZHANG L F, DU B. Kernel slow feature analysis for scene change detection[J]. IEEE transactions on geoscience and remote sensing, 2017, 55(4): 2367-2384. DOI: 10.1109/TGRS.2016.2642125.
    [3]
    POLLARD T, MUNDY J L. Change detection in a 3-d world[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition. DOI: 10.1109/CVPR.2007.383073.
    [4]
    RADKE R J, ANDAR S, AL-KOFAHI O, et al. Image change detection algorithms: a systematic survey[J]. IEEE transactions on image processing, 2005, 14(3): 294-307. DOI: 10.1109/TIP.2004.838698.
    [5]
    CRISPELL D, MUNDY J, TAUBIN G. A variable-resolution probabilistic three-dimensional model for change detection[J]. IEEE transactions on geoscience and remote sensing, 2012, 50(2): 489-500. DOI: 10.1109/TGRS.2011.2158439.
    [6]
    HUERTAS A, NEVATIA R. Detecting changes in aerial views of man-made structures[J]. Image and vision computing, 2000, 18(8): 583-596. DOI: 10.1016/S0262-8856(99)00063-3.
    [7]
    EDEN I, COOPER D B. Using 3D line segments for robust and efficient change detection from multiple noisy images[J]. Lecture notes in computer science, 2008: 172-185. DOI: 10.1007/978-3-540-88693-8_13.
    [8]
    TANEJA A, BALLAN L, POLLEFEYS M. Image based detection of geometric changes in urban environments[C]//2011 International Conference on Computer Vision. DOI: 10.1109/ICCV.2011.6126515.
    [9]
    SAKURADA K, OKATANI T. Change detection from a street image pair using CNN features and superpixel segmentation[C]//Proceedings of the British Machine Vision Conference (BMVC), BMVA Press, 2015. DOI: 10.5244/C.29.61.
    [10]
    CHEN L C, ZHU Y K, PAPANDREOU G, et al. Encoder-decoder with arous separable convolution for semantic image segmentation[C]//Proceedings of the European Conference on Computer Vision, 2018: 833-851. DOI: 10.1007/978-3-030-01234-2_49.
    [11]
    BOYKOV Y Y, JOLLY M P. Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images[C]//Proceedings Eighth IEEE International Conference on Computer Vision, ICCV 2001. DOI: 10.1109/ICCV.2001.937505.
    [12]
    SAKURADA K, OKATANI T, DEGUCHI K. Detecting changes in 3D structure of a scene from multi-view images captured by a vehicle-mounted camera[C]//Proceedings of the 2013 IEEE Computer Vision and Pattern Recognition, IEEE, 2013: 137-144. DOI: 10.1109/CVPR.2013.25.
    [13]
    马骕, 邓喀中, 庄会富, 等. 中低分辨率合成孔径雷达影像多纹理特征的Otsu变化检测[J]. 激光与光电子学进展, 2017, 54(6): 299-305.
    [14]
    田淞, 宋建社, 张雄美, 等. KM-SVM法的SAR图像无监督变化检测[J]. 系统工程与电子技术, 2015, 37(5): 1042-1046.
    [15]
    BOVOLO F, BRUZONE L. A detail-preserving scale-driven approach to change detection in multitemporal SAR images[J]. IEEE transactions on geoscience and remote sensing, 2005, 43(12): 2963-2972. DOI: 10.1109/TGRS.2005.857987.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(6)  / Tables(2)

    Article Metrics

    Article views (463) PDF downloads(23) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return