|
|
- 2018
面向三维城市建模的多点云数据融合方法综述
|
Abstract:
多细节层次的三维城市模型是数字城市和智慧社会的关键空间数据基础设施，从基于稀疏点线特征的交互式半自动化建模到基于密集点云的自动化智能化建模已经成为国际学术界和工业界的热点前沿。由于立体城市空间结构的复杂性，多类型、多站点和多时相的点云数据融合处理是三维城市建模的基本途径，其基本思想是将具有不同视角、密度、精度、尺度、细节、时间历元等特征的多点云数据进行一致性融合表达与集成处理，建立可直接面向计算分析的智能化表达的多点云模型。归纳总结了多点云数据的主要特点，针对时空基准与精度、尺度、语义3个层面的一致性处理，分析了多点云数据融合的主要发展趋势，并凝练了面向三维城市建模的多点云数据融合关键问题
| [1] | Matthew B, Andrea T, Leem S, et al. A Survey of Surface Reconstruction from Point Clouds[J]. Computer Graphics Forum,2016, 36(1):301-329 |
| [2] | Zhang Zhichao. Airborne and Terrestrial LiDAR Data Fusion for 3D Building Reconstruction[D]. Wuhan:Wuhan University,2010(张志超. 融合机载与地面LiDAR数据的建筑物三维重建研究[D]. 武汉:武汉大学,2010) |
| [3] | Li Lelin, Jiang Wanshou, Li Chaokui. A Multi-scale Filtering Method for LiDAR Point Clouds Conside-ring Terrain Complexity[J]. Science of Surveying and Mapping,2016, 41(11):130-136(李乐林,江万寿,李朝奎. 一种顾及地形复杂度的LiDAR点云多尺度滤波方法[J]. 测绘科学,2016, 41(11):130-136) |
| [4] | Gong Jun, Ke Shengnan, Zhu Qing, et al. An Efficient Management Method for Point Cloud Data Based on Octree and 3D R-tree[J]. Acta Geodaetica et Cartographica Sinica, 2012, 41(4):597-604(龚俊,柯胜男,朱庆,等. 一种八叉树和三维R树集成的激光点云数据管理方法[J]. 测绘学报,2012, 41(4):597-604) |
| [5] | Ying Shen, Guo Renzhong, Jin Fengzan, et al. Auto-Construction of 3D Colsed Buildings from CityGML LoD3[J]. Geomatics and Information Science of Wuhan University, 2018, 43(5):732-738(应申,郭仁忠,靳凤攒,等. 利用CityGML模型自动构建三维封闭建筑体[J]. 武汉大学学报·信息科学版,2018, 43(5):732-738) |
| [6] | Qi C R, Su H, Mo K C, et al. PointNet:Deep Learning on Point Sets for 3D Classification and Segmentation[C]. IEEE Conference on Computer Vision and Pattern Recognition,Honolulu, Hawaii, USA,2017 |
| [7] | Ken O, Hugo L, Filip B, et al. Modeling a 3D City Model and Its Levels of Detail as a True 4D Model[J]. ISPRS International Journal of Geo-Information,2015, 4(3):1055-1075 |
| [8] | Zhu Qing, Lin Hui. Digital City Geographic Information System:A Preliminary Exploration of 3D Urban Model in Virtual Urban Environment[M]. Wuhan:Wuhan University Press, 2004(朱庆,林珲. 数码城市地理信息系统:虚拟城市环境中的三维城市模型初探[M]. 武汉:武汉大学出版社, 2004) |
| [9] | George V,Maximilian C,Franz R. Contextual Segment-Based Classification of Airborne Laser Scanner Data[J]. ISPRS Journal of Photogrammetry & Remote Sensing,2017, 128:354-371 |
| [10] | Yang Bisheng, Liang Fuxun, Huang Ronggang. Challenges and Perspectives of 3D LiDAR Point Cloud Processing[J]. Acta Geodaetica et Cartographica Sinica,2017, 46(10):1509-1516(杨必胜,梁福逊,黄荣刚. 三维激光扫描点云数据处理研究进展、挑战与趋势[J]. 测绘学报,2017, 46(10):1509-1516) |
| [11] | Poux F, Hallot P, Neuville R, et al. Smart Point Cloud:Definition and Remaining Challenges[C]. The 11th 3D Geoinfo Conference, Athens,Greece,2016 |
| [12] | Wang Jiayao. Cartography in the Age of Spatio-temporal Big Data[J]. Acta Geodaetica et Cartographica Sinica,2017, 46(10):1226-1237(王家耀. 时空大数据时代的地图学[J]. 测绘学报,2017, 46(10):1226-1237) |
| [13] | Zhu Qing, Chen Chongtai, Hu Han, et al. An Adaptive Dense Matching Method for Airborne Images Using Texture Information[J]. Acta Geodaetica et Cartographica Sinica,2017, 46(1):62-72(朱庆,陈崇泰,胡翰,等. 顾及纹理特征的航空影像自适应密集匹配方法[J]. 测绘学报,2017, 46(1):62-72) |
| [14] | Stevenm S, Brian C, James D, et al. A Comparison and Evaluation of Multi-view Stereo Reconstruction Algorithms[C]. 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York,USA,2006 |
| [15] | Yannick V,Florent L,Pierre A. LOD Generation for Urban Scenes[J]. ACM Transactions on Grap-hics,2015, 34(3):1-14 |
| [16] | Yan L, Tan J, Liu H, et al. Automatic Registration of TLS-TLS and TLS-MLS Point Clouds Using a Genetic Algorithm[J].Sensors (Basel),2017, 17(9),DOI:10.3390/s17091979 |
| [17] | Ye Qin, Yao Yahui, Gui Popo. Kinect Point Cloud Registration Method Based on Epipolar and Point-to-Plane Constraint[J]. Geomatics and Information Science of Wuhan University,2017, 42(9):1271-1277(叶勤,姚亚会,桂坡坡. 基于极线及共面约束条件的Kinect点云配准方法[J]. 武汉大学学报·信息科学版, 2017, 42(9):1271-1277) |
| [18] | Nicolas M, Dror A, Niloyj M. Super 4PCS Fast Global Point Cloud Registration via Smart Indexing[J]. Computer Graphics Forum,2015, 33(5):205-215 |
| [19] | Yan Li, Hu Xiaobin, Xie Hong. Data Management and Visualization of Mobile Laser Scanning Point Cloud[J]. Geomatics and Information Science of Wuhan University,2017, 42(8):1131-1136(闫利,胡晓斌,谢洪. 车载LiDAR海量点云数据管理与可视化研究[J]. 武汉大学学报·信息科学版,2017, 42(8):1131-1136) |
| [20] | Mandlburger G, Wenzel K, Spitzer A, et al.Improved Topographic Models via Concurrent Airborne LiDAR and Dense Image Matching[C]. ISPRS Annals of the Photogrammetry, Remote Sen-sing and Spatial Information Sciences, Wuhan, China,2017 |
| [21] | Zhu Junfeng, Hu Xiangyun, Zhang Zuxun, et al. Hierarchical Outlier Detection for Point Cloud Data Using a Density Analysis Method[J]. Acta Geodaetica et Cartographica Sinica,2015, 44(3):282-291(朱俊锋,胡翔云,张祖勋,等. 多尺度点云噪声检测的密度分析法[J]. 测绘学报, 2015, 44(3):282-291) |
| [22] | Gerhard G,Lutz P. CityGML-Interoperable Semantic 3D City Models[J]. ISPRS Journal of Photogrammetry & Remote Sensing,2012, 71:12-33 |
| [23] | Gong Jun, Zhu Qing, Zhong Ruofei, et al. An Efficient Point Cloud Management Method Based on a 3D R-Tree[J].Photogrammetric Engineering & Remote Sensing,2012, 74(4):373-381 |
| [24] | Angela D, Daniel R, Martin B, et al. ScanComplete:Large-Scale Scene Completion and Semantic Segmentation for 3D Scans[C]. IEEE Conference on Computer Vision and Pattern Recognition,Honolulu, Hawaii, USA,2017 |
| [25] | Feng Yun, Cui Lei, He Xiaowei. From 2D to 3D:Medical Image Analysis and Organ 3D Reconstruction[M]. Beijing:Science Press, 2016(冯筠,崔磊,贺小伟. 从二维到三维:医学影像分析及器官三维重建[M]. 北京:科学出版社, 2016) |
| [26] | Gross H, Thoennessen U. Extraction of Lines from Laser Point Clouds[J]. International Archives of Photogrammetry,Remote Sensing and Spatial Information Sciences, 2006,36(3):86-93 |
| [27] | Wu Huifeng, Tang Jianlin, Long Ying. Multi-scale DEM Generation Method Based on Airborne LiDAR Point Cloud[J]. Science of Surveying and Mapping,2017, 42(5):131-135(吴惠丰,唐健林,龙盈. 机载LiDAR点云生成多尺度DEM方法[J]. 测绘科学, 2017, 42(5):131-135) |
| [28] | Zhou Yingqun, Xu Ling, Wang Bingfang, et al. Modified Sequential Therapy Regimen Versus Conventional Triple Therapy for Helicobacter Pylori Eradication in Duodenal Ulcer Patients in China:A Multicenter Clinical Comparative Study[J]. Gastroen-terology Research and Practice,2012, 2012(5):1-8 |
| [29] | Poullis C. A Framework for Automatic Modeling from Point Cloud Data[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence,2013, 35(11):2563-2575 |
| [30] | Paulj B, Neild M. A Method for Registration of 3-D Shapes[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(2):239-256 |
| [31] | Chen Yang, Gérard M. Object Modelling by Registration of Multiple Range Images[J]. Image & Vision Computing, 1992, 10(3):145-155 |
| [32] | Wang Yongbo, Wang Yunjia, She Wenwen, et al. A Linear Features Constrained, Plücker Coordinates Based, Closed-form Registration Approach for Terrestrial LiDAR Point Cloud[J]. Geomatics and Information Science of Wuhan University, 2018, 42(9):1376-1384(王永波,汪云甲,佘雯雯,等. 直线特征约束下利用Plücker坐标描述的LiDAR点云无初值配准方法[J]. 武汉大学学报·信息科学版,2018, 42(9):1376-1384) |
| [33] | Zhang Jixian, Lin Xiangguo, Liang Xinlian.Advances and Prospects of Information Extraction from Point Clouds[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(10):1460-1469(张继贤,林祥国,梁欣廉. 点云信息提取研究进展和展望[J]. 测绘学报, 2017, 46(10):1460-1469) |
| [34] | Radubogdan R,Nico B, Zoltancsaba M, et al. Aligning Point Cloud Views Using Persistent Feature Histograms[C]. IEEE International Conference on Robotics and Automation,Nice, France,2013 |
| [35] | Jan B, Norbert H. Efficient Integration of Aerial and Terrestrial Laser Data[J]. Uni Stuttgart-Universit？tsbibliothek,2007, 36(3):192-197 |
| [36] | Yang Bisheng, Xu Wenxue, Dong Zhen. Automated Extraction of Building Outlines from Airborne Laser Scanning Point Clouds[J]. IEEE Geoscience & Remote Sensing Letters,2013, 10(6):1399-1403 |
| [37] | Zhang K, Yan J, Chen S C. Automatic Construction of Building Footprints from Airborne LiDAR Data[J]. IEEE Transactions on Geoscience & Remote Sensing,2006, 44(9):2523-2533 |
| [38] | Zhu Jihua, Meng Deyu, Li Zhongyu, et al. Robust Registration of Partially Overlapping Point Sets via Genetic Algorithm with Growth Operator[J]. IET Image Processing,2014, 8(10):582-590 |
| [39] | Brunnstrom K, Stoddart A J. Genetic Algorithms for Free-Form Surface Matching[C]. International Conference on Pattern Recognition, Vienna, Austria,1996 |
| [40] | Jeanjosé J, Christian R. Registration of 3-D Images by Genetic Optimization[J]. Pattern Recognition Letters,1995, 16(8):823-841 |
| [41] | Hirschmüller H. Stereo Processing by Semiglobal Matching and Mutual Information[J]. IEEE Tran-sactions on Pattern Analysis & Machine Intelligence,2008, 30(2):328-341 |
| [42] | Huang Hui, Wu Shihao, Gong Minglun, et al. Edge-Aware Point Set Resampling[J]. ACM Tran-sactions on Graphics,2013, 32(1):1-12 |
| [43] | Li Lixue, Li Yongqiang, Wang Li, et al. Fine Segmentation of Building Facade Combined Mobile LiDAR with Airborne LiDAR Point Cloud Data[J]. Journal of Geomatics Science and Technology,2017, 34(2):181-186(李立雪,李永强,王力,等. 车载联合机载LiDAR点云数据的建筑物立面精细分割[J]. 测绘科学技术学报,2017, 34(2):181-186) |
| [44] | Wu Bo, Tang Shengjun. Review of Geometric Fusion of Remote Sensing Imagery and Laser Scanning Data[J]. International Journal of Image & Data Fusion,2015, 6(2):97-114 |
| [45] | Longley P A, Goodchild M F, Maguire D J, et al. Geographic Information Systems and Science[M]. New York:Wiley, 2001 |
| [46] | Zhang Yunfei. Methods for Congruent Conflation of Multi-source Road Networks and POIs[D]. Wuhan:Wuhan University, 2015(张云菲. 多源道路网与兴趣点的一致性整合方法[D]. 武汉:武汉大学,2015) |
| [47] | Huising E J, Lmgomes P. Errors and Accuracy Estimates of Laser Data Acquired by Various Laser Scanning Systems for Topographic Applications[J]. ISPRS Journal of Photogrammetry & Remote Sensing,1998, 53(5):245-261 |
| [48] | He Lei, Yu Chunping, Li Guangyun. Method of Laser Scanning Data Matching[J]. Journal of Geomatics Science and Technology, 2008, 25(6):410-413(贺磊,余春平,李广云. 激光扫描数据的多站配准方法[J]. 测绘科学技术学报,2008, 25(6):410-413) |
| [49] | Lan Qiuping, Tian Qinghong, Li Zikuan, et al. Automatic Registration of Multi-site Point Cloud with Ball Target[J]. Journal of Geomatics,2018,43(6),doi:10.14188/j.2095-6045.2017120(蓝秋萍,田青红,李子宽,等. 利用球目标的多测站点云自动配准[J]. 测绘地理信息,2018,43(6), doi:10.14188/j.2095-6045.2017120) |
| [50] | Armin G, Devrim A. Least Squares 3D Surface and Curve Matching[J]. ISPRS Journal of Photogrammetry & Remote Sensing,2005, 59(3):151-174 |
| [51] | Teo T A, Huang S H. Surface-Based Registration of Airborne and Terrestrial Mobile LiDAR Point Clouds[J]. Remote Sensing,2014, 6(12):12686-12707 |
| [52] | Song Wenbo,Jamesm K, Timothyl H, et al. Relaxation-Based Point Feature Matching for Vector Map Conflation[J]. Transactions in GIS,2011, 15(1):43-60 |
| [53] | Zhang Jixian, Lin Xiangguo. Advances in Fusion of Optical Imagery and LiDAR Point Cloud Applied to Photogrammetry and Remote Sensing[J]. International Journal of Image & Data Fusion,2016, 8(1):1-31 |
| [54] | Aparajithan S, Shan Jie. Building Boundary Tracing and Regularization from Airborne LiDAR Point Clouds[J]. Photogrammetric Engineering & Remote Sensing,2007, 73(7):805-812 |
| [55] | Yang Bisheng, Zang Yufu. Automated Registration of Dense Terrestrial Laser-Scanning Point Clouds Using Curves[J]. ISPRS Journal of Photogrammetry & Remote Sensing,2014, 95(3):109-121 |
| [56] | Julge K, Ellmann A. Combining Airborne and Terrestrial Laser Scanning Technologies for Measuring Complex Structures[M].The 10th International Conference Environmental Engineering, Vilnius, Lithuania,2014 |
| [57] | Yang Bisheng, Dong Zhen, Liang Fuxun, et al. Automatic Registration of Large-Scale Urban Scene Point Clouds Based on Semantic Feature Points[J]. ISPRS Journal of Photogrammetry & Remote Sensing,2016, 113:43-58 |
| [58] | Norbert H, Mathias R. Dense Multi-stereo Mat-ching for High Quality Digital Elevation Models[J]. Photogrammetrie-Fernerkundung-Geoinformation,2012, 2012(4):331-343 |
| [59] | Chen Xijiang, Hua Xianghong, Zhang Guang, et al. Using Error Entropy to Evaluate Point Cloud Uncertainty Influenced by Spot[J]. Geomatics and Information Science of Wuhan University, 2017, 42(6):864-868(陈西江,花向红,章光,等. 利用误差熵评价光斑中点云不确定性[J]. 武汉大学学报·信息科学版,2017, 42(6):864-868) |
| [60] | Li Yongqiang, Niu Lubiao, Li Lixue, et al. HoleFilling of Building Facade Based on LiDAR Point Cloud[J]. Science of Surveying and Mapping,2017, 42(10):191-195(李永强,牛路标,李立雪,等. LiDAR点云的建筑物立面空洞修复[J]. 测绘科学,2017, 42(10):191-195) |
| [61] | Maros B, Christoph V, Audrey R, et al. Large-Scale Semantic 3D Reconstruction:An Adaptive Multi-resolution Model for Multi-class Volumetric Labeling[C]. IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas, NV, United States,2016 |
| [62] | Dror A, Niloyj M, Daniel C O. 4-Points Congruent Sets for Robust Pairwise Surface Registration[J]. ACM Transactions on Graphics,2008, 27(3):1-10 |
| [63] | Wang Hongtao, Zhang Wuming, Chen Yiming, et al. Semantic Decomposition and Reconstruction of Compound Buildings with Symmetric Roofs from LiDAR Data and Aerial Imagery[J]. Remote Sen-sing,2015, 7(10):13945-13974 |
| [64] | Tong Lihua, Cheng Liang, Li Manchun, et al. Re-gistration of Vehicle and Airborne LiDAR with Building Contours[J]. Acta Geodaetica et Cartographica Sinica,2013, 42(5):699-706(童礼华,程亮,李满春,等. 建筑轮廓的车载和航空LiDAR数据配准[J]. 测绘学报,2013, 42(5):699-706) |
| [65] | Moskal L M, Erdody T, Kato A, et al. LiDAR Applications in Precision Forestry[C]. Proceedings of SilviLaser,Texas, USA,2009 |
| [66] | Cao Hong. Research on Buildings' Three-dimensional Reconstruction Based on Air Borne and Vehicle Borne LiDAR Data[D]. Jiaozuo:Henan Polytechnic University,2014(曹鸿. 基于空-地LiDAR数据的建筑物三维重建研究[D]. 焦作:河南理工大学,2014) |
| [67] | Yang Bisheng, Zang Yufu, Dong Zhen, et al. An Automated Method to Register Airborne and Terrestrial Laser Scanning Point Clouds[J]. ISPRS Journal of Photogrammetry & Remote Sensing,2015, 109:62-76 |
| [68] | Markus G, Xiao Jing. Fusion of Airborne Laser-Scanning Point Clouds and Images for Supervised and Unsupervised Scene Classification[J].ISPRS Journal of Photogrammetry & Remote Sensing,2014, 87(1):78-92 |
| [69] | Zhang Jianfeng, Nie Jun. Transformation of Complex Internal Structures of Poly(Ethylene Oxide)/Chitosan Oligosaccharide Electrospun Nanofibers[J]. Polymer International,2015, 61(1):135-140 |
| [70] | Liu Fangyu, Li Shuaipeng, Zhang Liqiang, et al. 3DCNN-DQN-RNN:A Deep Reinforcement Lear-ning Framework for Semantic Parsing of Large-scale 3D Point Clouds[C]. IEEE Conference on Computer Vision and Pattern Recognition,Honolulu, Hawaii, USA,2017 |
| [71] | Jorge H, Beatriz M. Filtering of Artifacts and Pavement Segmentation from Mobile LiDAR Data[C]//Bretar F,Pierrot-Deseilligny M,Vosselman G.Laser Scanning 2009,IAPRS,2013,38(3/W8):329-333 |
| [72] | Huang Ronggang, Yang Bisheng, Li Jianping, et al. Building Points Detection from Airborne LiDAR Point Clouds Using Topological Relationship Graph Within Each Object Region[J]. Geomatics and Information Science of Wuhan University,2017, 42(4):475-481(黄荣刚,杨必胜,李健平,等. 利用目标区域拓扑关系图提取建筑物点云[J]. 武汉大学学报·信息科学版,2017, 42(4):475-481) |
| [73] | Zhu Qing. Analysis of 3D GIS and the Application in Intelligent City[J]. Journal of Geo-Information Science,2014, 16(2):151-157(朱庆. 三维GIS及其在智慧城市中的应用[J]. 地球信息科学学报,2014, 16(2):151-157) |
| [74] | Feng Shuai. Comparison of Image Matching Point Clouds with LiDAR Point Clouds[J]. Geospatial Information,2014, 12(6):82-83(冯帅. 影像匹配点云与机载激光点云的比较[J]. 地理空间信息,2014, 12(6):82-83) |
| [75] | Zhu Qing, Li Yuan, Hu Han, et al. Robust Point Cloud Classification Based on Multi-level Semantic Relationships for Urban Scenes[J]. ISPRS Journal of Photogrammetry & Remote Sensing,2017, 129:86-102 |
| [76] | Li Deren, Yao Yuan, Shao Zhenfeng. The Concept, Supporting Technologies and Applications of Smart City[J]. Journal of Engineering Studies,2012, 4(4):313-323(李德仁,姚远,邵振峰. 智慧城市的概念、支撑技术及应用[J]. 工程研究——跨学科视野中的工程,2012, 4(4):313-323) |
| [77] | Li Yangyan, Bu Rui, Sun Mingchao, et al. Point-CNN[C]. IEEE Conference on Computer Vision and Pattern Recognition,Salt Lake City, USA,2018 |
