全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...
电网技术  2014 

采用Map-Reduce模型的海量电能质量数据交换格式文件快速解析方案

DOI: 10.13335/j.1000-3673.pst.2014.06.045, PP. 1705-1711

Keywords: 电能质量,PQDIF文件,Map-Reduce模型,海量数据解析,Hadoop

Full-Text   Cite this paper   Add to My Lib

Abstract:

针对现有方案对电能质量监测系统中海量PQDIF文件解析效率低、解析时间长等问题,研究实现了一种基于集群计算架构的海量PQDIF文件快速解析方案。通过Map-Reduce模型来实现海量PQDIF文件的快速并行解析。Map-Reduce模型将数据集的大规模操作任务拆分成若干子任务分配给网络上的每一个计算节点(如PC机),实现多计算节点共同协调处理任务,达到提高运行效率的目的。方案采用Java和C++编写,在异构平台间具有较强的可移植性,并且可以通过增加计算节点来提高解析效率,具有较强的可扩展性。通过对海量PQDIF文件进行解析测试,结果表明该方案可以显著提高文件解析效率。

References

[1]  袁晓东,罗曦,顾伟.电能质量监测统一平台及PQDIF数据格式研究[J].江苏电机工程,2009,28(5):29-51. Yuan Xiaodong,Luo Xi,Gu Wei.Research on united platform of power quality monitoring and PQDIF data format[J].Jiangsu Electrical Engineering,2009,28(5):29-51(in Chinese).
[2]  赵丽平,解绍锋,李群湛,等.基于多智能体的电气化铁道电能质量监控系统[J].电网技术,2004,28(24): 69-73. Zhao Liping,Xie Shaofeng,Li Qunzhan,et al.Study on multi-agent based power quality monitoring and control system for electrified railway[J].Power System Technology,2004,28(24):69-73(in Chinese).
[3]  张逸,杨洪耕.海量电能质量数据交换格式文件快速解析方案[J].电力自动化设备,2013,33(12):116-121. Zhang Yi,Yang Honggeng.Fast parsing of massive PQDIF files[J].Electric Power Automation Equipment,2013,33(12):116-121(in Chinese).
[4]  White T.Hadoop权威指南[M].周敏奇,王晓玲,金澈清等,译.北京:清华大学出版社,2011:167-188.
[5]  Lam C.Hadoop 实战[M].韩冀中,译.北京:人民邮电出版社,2011:17-30.
[6]  张逸,杨洪耕,林瑞星,等.电能质量数据交换格式文件通用解析方案[J].电力系统自动化,2012,36(11):86-91. Zhang Yi,Yang Honggeng,Lin Ruixing,et al.A general parsing scheme for power quality data interchange format files[J].Automation of Electric Power Systems,2012,36(11):86-91(in Chinese).
[7]  聂晶晶.电能质量监测系统及PQDIF数据存储格式的研究[D].南京:东南大学,2006.
[8]  Rajaraman A,UIIman J D.大数据:互联网大规模数据挖掘与分布式处理[M].王斌,译.北京,人民邮电出版社,2012:16-35.
[9]  桂勋,姚兰,钱清泉,等.海量COMTRADE数据并行解析算法[J].电力系统自动化,2009,33(15):62-66. Gui Xun,Yao Lan,Qian Qingquan,et al.A massive COMTRADE data parallel parsing algorithm[J].Automation of Electric Power Systems,2009,33(15):62-66(in Chinese).
[10]  IEEE Standards Coordinating Committee 22 on Power Quality.IEEE 1159.3—2003 IEEE recommended practice for the transfer of power quality data[S].New York,NY,USA:IEEE,2004.
[11]  焦东升,陆冬良,应俊豪,等.动态电能质量实时监测系统的设计与实现[J].电网技术,2011,35(5):110-114. Jiao Dongsheng,Lu Dongliang,Ying Junhao,et al.Design and implementation of dynamic power quality real-time monitoring system[J].Power System Technology,2011,35(5):110-114(in Chinese).
[12]  范瑞祥,辛建波,上官帖,等.浙赣电气化铁路江西段开放式电能质量监测系统的开发与应用[J].电网技术,2008,32(21):68-74. Fan Ruixiang,Xin Jianbo,Shangguan Tie,et al.Development and application of open-type power quality monitoring system for Jiangxi section of Zhejiang-Jiangxi electrified railway[J].Power System Technology,2008,32(21):68-74(in Chinese).
[13]  韦永忠,郑爱霞,袁晓冬,等.江苏电网电能质量评估方法及应用[J].江苏电机工程,2011,30(5):1-4 Wei Yongzhong,Zheng Aixia,Yuan Xiaodong,et al.Application of power quality assessment in Jiangsu power system[J].Jiangsu Electrical Engineering,2011,30(5):1-4(in Chinese).
[14]  何维国,谢伟,张健.上海电网电能质量监测系统[J].华东电力,2010,38(4):497-499. He Weiguo,Xie Wei,Zhang Jian.Power quality monitoring system of Shanghai grid[J].East China Electric Power,2010,38(4):497-499(in Chinese).
[15]  翁国庆,张有兵.网络化电能质量监测与分析系统的设计[J].电力系统自动化,2008,32(15):79-83. Weng Guoqing,Zhang Youbing.Design of a networked power quality monitoring and analysis system[J].Automation of Electric Power Systems,2008,32(15):79-83(in Chinese).
[16]  朱伟立,王俊,王巍,等.PQDIF在嵌入式电能质量监测终端上的实现与应用[J].江苏电机工程,2011,30(2):59-62,65. Zhu Weili,Wang Jun,Wang Wei,et al.Realization and application of PQDIF in embedded power quality monitor terminal[J].Jiangsu Electrical Engineering,2011,30(2):59-62,65(in Chinese).

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133