|
|
西南诸河流域水利信息化综合管理平台设计研究
|
Abstract:
随着国家对加快水利信息化升级转型的不断推进，以及天空地一体化水利感知网的建立，水利智能感知水平提升和水利大数据的建立成为必然趋势。水利大数据时代的到来使其数据量容量发生指数增长，对数据获取方式、数据类型、数据管理方式、空间分析能力等提出了新的要求。研究基于水利大数据技术阐述了水利大数据的基本概念，结合西南诸河流域的水利数据资源情况，从水利数据资源池的建立、水利大数据运维管理体系设计、基于Hadoop分布式数据存储模式的平台架构设计等方面进行论述，为平台应用落地提供技术保障。
With the continuous promotion of to accelerate the upgrading and transformation of water informatization and the establishment of the sky earth integrated water conservancy perception network, the improvement of water conservancy intelligent perception level and the establishment of water conservancy big data have become an inevitable trend. The arrival of the era of big data in water conservancy makes its data volume and capacity grow exponentially, which puts forward new requirements for data acquisition methods, data types, data management methods, spatial analysis capabilities, etc. Based on the water conservancy big data technology, this paper expounds the basic concept of water conservancy big data. Combined with the water conservancy data resources of the southwest rivers of China, it discusses the establishment of water conservancy data resource pool, the design of water conservancy big data operation and maintenance management system, and the design of platform architecture based on Hadoop distributed data storage mode, so as to provide technical support for the implementation of platform applications.
| [1] | 维克托？迈尔？舍恩伯格, 周涛. 大数据时代[J]. 房地产导刊, 2013(4): 113.
VICTOR, M. S., ZHOU Tao. Big data era. Real Estate Guide, 2013(4): 113. (in Chinese) |
| [2] | 蒋云钟, 冶运涛, 赵红莉, 梁犁丽, 曹引, 顾晶晶. 水利大数据研究现状与展望[J]. 水力发电学报, 2020, 39(10): 1-32.
JIANG Yunzhong, YE Yuntao, ZHAO Hongli, LIANG Lili, CAO Yin and GU Jingjing. Research status and prospect of water conservancy big data. Journal of Hydropower, 2020, 39(10): 1-32. (in Chinese) |
| [3] | GIJZEN, H. Development: Big data for a sustainable future. Nature, 2013, 502(7469): 38. https://doi.org/10.1038/502038d |
| [4] | 陈能成, 肖长江, 杨超, 等. 地理空间传感网融合服务技术与应用[J]. 地球信息科学学报, 2020, 22(1): 11-20.
CHEN Nengcheng, XIAO Changjiang, YANG Chao, et al. Geospatial sensor network fusion service technology and application. Journal of Earth Information Science, 2020, 22(1): 11-20. (in Chinese) |
| [5] | 冶运涛, 蒋云钟, 梁犁丽, 等. 智慧水利大数据理论与方法[M]. 北京: 科学出版社, 2020.
YE Yuntao, JIANG Yunzhong, LIANG Lili, et al. Smart water conservancy big data theory and method. Beijing: Science Press, 2020. (in Chinese) |
| [6] | 岩腊, 龙笛, 白亮亮, 等. 基于多源信息的水资源立体监测研究综述[J]. 遥感学报, 2020, 24(7): 787-803.
YAN La, Long Di, BAI Liangliang, et al. Review on three-dimensional monitoring of water resources based on multi-source information. Journal of Remote Sensing, 2020, 24(7): 787-803. (in Chinese) |
| [7] | 蒋云钟, 冶运涛, 赵红莉. 智慧水利大数据内涵特征、基础架构和标准体系研究[J]. 水利信息化, 2019(4): 6-19.
JIANG Yunzhong, YE Yuntao and ZHAO Hongli. Research on connotation characteristics, infrastructure and standard system of smart water conservancy big data. Water Conservancy Informatization, 2019(4): 6-19. (in Chinese) |
| [8] | MILLER, H. G., MORK, P. From data to decisions: A value chain for big data. IT Professional, 2013, 15(1): 57-59.
https://doi.org/10.1109/MITP.2013.11 |
| [9] | KRIKSCIUNIENE, D., SAKALAUSKAS, V. and KRIKSCIUNAS, B. Process optimization and monitoring along big data value chain. In ABRAMOWICZ, W. Lecture notes in business information processing. Cham: Springer, 2015: 75-86.
https://doi.org/10.1007/978-3-319-26762-3_8 |
| [10] | CURRY, E. The big data value chain: definitions, concepts, and theoretical approaches. In CAVANILLAS, J., CURRY, E. and WAHLSTER, W. New horizons for a data driven economy. Cham: Springer, 2016: 29-37.
https://doi.org/10.1007/978-3-319-21569-3_3 |
| [11] | 陈华, 徐坚, 肖志远, 等. 水文大数据共享平台研究与设计[J]. 水资源研究, 2018, 7(1): 10-18.
CHEN Hua, XU Jian, XIAO Zhiyuan, et al. Research and design of hydrological big data sharing platform. Journal of Water Resources Research, 2018, 7(1): 10-18. (in Chinese) |
| [12] | 孙洪林. 国家防汛抗旱指挥系统中数据汇集平台的设计和实现[J]. 中国防汛抗旱, 2020, 30(6): 20-26.
SUN Honglin. Design and implementation of data collection platform in national flood control and drought relief command system. China Flood Control and Drought Relief, 2020, 30(6): 20-26. (in Chinese) |
| [13] | 刘业森, 郭良, 张晓蕾, 等. 全国山洪灾害调查评价成果数据管理平台设[J]. 南水北调与水利科技, 2017, 15(6): 196-202.
LIU Yesen, GUO Liang, ZHANG Xiaolei, et al. Establishment of data management platform for national mountain flood disaster investigation and evaluation results. South to North Water Transfer and Water Conservancy Technology, 2017, 15(6): 196-202. (in Chinese) |
| [14] | 周江, 王伟平, 孟丹, 等. 面向大数据分析的分布式文件系统关键技术[J]. 计算机研究与发展, 2014, 51(2): 382-394.
ZHOU Jiang, WANG Weiping, MENG Dan, et al. Key technologies of distributed file system for big data analysis. Computer Research and Development, 2014, 51(2): 382-394. (in Chinese) |
| [15] | 金国栋, 卞昊穹, 陈跃国, 等. HDFS 存储和优化技术研究综述[J]. 软件学报, 2020, 31(1): 137-161.
JIN Guodong, BIAN Haoqiong, CHEN Yueguo, et al. Review of HDFS storage and optimization technology. Journal of Software, 2020, 31(1): 137-161. (in Chinese) |
| [16] | 程学旗, 靳小龙, 王元卓, 等. 大数据系统和分析技术综述[J]. 软件学报, 2014, 25(9): 1889-1908.
CHENG Xueqi, JIN Xiaolong, WANG Yuanzhuo, et al. Overview of big data system and analysis technology. Journal of Software, 2014, 25(9): 1889-1908. (in Chinese) |
| [17] | 吴飞. 大数据环境下的数据存储及应用研究[J]. 科技视界, 2021(32): 10-12.
https://doi.org/10.19694/j.cnki.issn2095-2457.2021.32.04 WU Fei. Research on data storage and application in big data environment. Science and Technology Horizon, 2021(32): 10-12. https://doi.org/10.19694/j.cnki.issn2095-2457.2021.32.04 (in Chinese) |
| [18] | 上官博屹, 乐鹏. 流计算与传感网集成的城市内涝模型实时感知研究[J]. 地理信息世界, 2018, 25(3): 1-6.
SHANGGUAN Boyi, LE Peng. Research on real-time sensing of urban waterlogging model integrated with flow computing and sensor network. Geographic Information World, 2018, 25(3): 1-6. (in Chinese) |
| [19] | 王慧敏, 李臣明, 彭建华, 等. 基于流式大数据处理方式的降雨径流预测计算方法[P]. 中国, CN106446359B. 2019-05-03.
WANG Huimin, LI Chenming, PENG Jianhua, et al. Calculation method of rainfall runoff prediction based on streaming big data processing. CN106446359b. 2019-05-03. (in Chinese) |
| [20] | 王一旭, 王飞儿, 俞洁. 基于自组织映射与随机森林耦合模型的流域水质空间差异性评估[J]. 环境科学学报, 2020, 40(6): 2278-2285.
WANG Yixu, WANG Feier and YU Jie. Spatial difference assessment of watershed water quality based on self-organizing mapping and random forest coupling model. Journal of Environmental Science, 2020, 40(6): 2278-2285. (in Chinese) |
