全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

大数据全生命周期中关键问题研究及应用

DOI: 10.13334/j.0258-8013.pcsee.2015.01.003, PP. 23-28

Keywords: 大数据,压缩存储,缓存机制,动态配置,统一数据资源库

Full-Text   Cite this paper   Add to My Lib

Abstract:

随着大数据时代的到来,大数据全生命周期中获取、存储、处理、挖掘等方面的研究逐步展开,成为行业、政府的研究热点。该文以国内外电力行业、金融、经济等数据为研究对象,对大数据的存储、处理、挖掘三大关键问题进行研究。根据大数据特点进行分类;建立基于改进稀疏矩阵、指标维度和指标数据分离方式的大数据压缩存储模型,实现大数据的压缩存储和动态扩展。提出按照指标分类及关联关系建立数据缓存模型的方法,实现大数据的高效访问和灵活转换。在挖掘展现时应用动态可配置的设计方法,解决数据查询海量页面的动态生成问题。该文可为大数据存储、处理、挖掘研究提供有价值的参考,并将研究成果应用到统一资源库的建设中。

References

[1]  Wikipedia.Big data[EB/OL].[2014-01-.http://en. wikipedia.org/wiki/Big_data.
[2]  涂子沛.大数据:正在到来的数据革命[M].广西:广西师范大学出版社,2012:57. Tu Zipei.The big data revolution[M].Guang Xi:Guang Xi Teacher’s University Press,2012:57(in Chinese).
[3]  周枫.大数据时代档案馆的特征及发展策略[J].档案与建设,2013(8):6-9. Zhou Feng.Archive’s characters and evolution in big data era[J].Archives and Construction,2013(8):6-9(in Chinese).
[4]  Science.Special online collection: Dealing with data[EB/OL].[2014-01-.http://www.sciencem ag.org/site/special/data/.
[5]  李建中,刘显敏.大数据的一个重要方面:数据可用性[J].计算机研究与发展,2013,50(6):1147-1162. Li Jianzhong,Liu Xianmin.An important aspect of big data:data usability[J].Journal of Computer Research and Development,2013,50(6):1147-1162(in Chinese).
[6]  陈明奇.中美两国大数据发展战略对比分析[J].人民论坛,2013(10):28-29. Chen Mingqi.Big data evolution strategy contrast between China and American[J].People¢s Tribune,2013(10):28-29(in Chinese).
[7]  李东卫.推进我国大数据开发应用的几点思考[J].重庆经济,2013(5):42-45. Li Dongwei.Thinking of big data development and application in China[J].Chongqing Economy,2013(5):42-45(in Chinese).
[8]  IDC.Extracting value from chaos[EB/OL].[2014-01-.http://www.itu.dk/people/rkva/2011-Fall-SMA/readings/ ExtractingValuefromChaos.pdf.
[9]  Swartz N.Gartner warns firms of ‘dirty data’[J].Information Management Journal,2007,41(3):6.
[10]  金培权,郝行军,岳丽华.面向新型存储的大数据存储架构与核心算法综述[J].计算机工程与科学,2013,35(10):12-24. Jin Peiquan,Hao Xingjun,Yue Lihua.A survey on storage architectures and core algorithms for big data management on new storages[J].Computer Engineering and Science,2013,35(10):12-24(in Chinese).
[11]  IBM.智慧的城市在中国[EB/OL].[2014-01-.http:// www.ibm.com/smarterplanet/cn/zh/smarter_cities/ideas. IBM.Smart city in china[EB/OL].[2014-01-01].http:// www.ibm.com/smarterplanet/cn/zh/smarter_cities/ideas(in Chinese).
[12]  徐秀敏,郝赫,曹占峰,等.基于三层B/S的规划计划信息管理平台[J].计算机系统应用,2013(4):51-54,78. Xu Xiumin,Hao He,Cao Zhanfeng,et al.Planning and programming information management platform based on three-tier B/S architecture[J].Computer Systems and Applications,2013(4):51-54,78(in Chinese).
[13]  韩英杰,石磊.基于最小延迟代价的Web缓存替换算法研究[J].计算机工程与设计,2008,29(8):1925-1928. Han Yingjie,Shi Lei.Least latency cost cache replacement policy and it¢s performance analysis[J].Computer Engineering and Design,2008,29(8):1925-1928(in Chinese).
[14]  刘磊,熊小鹏.最小驻留价值缓存替换算法[J].计算机应用,2013,33(4):1018-1022. Liu Lei,Xiong Xiaopeng.Least cache value replacement algorithm[J].Journal of Computer Applications,2013,33(4):1018-1022(in Chinese).
[15]  姜国松.一种高效、可扩展细粒度缓存管理混合存储研究[J].计算机科学,2013(8):79-82,108. Jiang Guosong.Research about efficient and scalable hybrid memories at fine-granularity cache management [J].Computer Science,2013(8):79-82,108(in Chinese).
[16]  Zhu Y,Yue J,Cai Z,et al,Hot random off-loading:A hybrid storage system with dynamic data migration[C]// Proceedings of IEEE 19th International Symposium on Modeling,Analysis & Simulation of Computer and Telecommunication Systems.Singaport:IEEE,2011:318-325.
[17]  Facebook.Flasheache[EB/OL].[2014-01-.https:// github.Com/facebook/flashcache.
[18]  吕瑞,孙林夫,刘述雅.面向产业链协同SaaS平台的表单动态配置技术[J].计算机应用,2013,33(10):2984-2988. Lü Rui,Sun Linfu,Liu Shuya.Form dynamic configuration technology for industrial-chain coordination SaaS platform[J].Journal of Computer Applications,2013,33(10):2984-2988(in Chinese).
[19]  唐文忠,莫伟栋.基于共享模型的工作流表单系统设计[J].北京航空航天大学学报,2008,34(4):391-395. Tang Wenzhong,Mo Weidong.Design of the workflow form system based on shared model[J].Journal of Beijing University of Aeronautics and Astronautics,2008,34(4):391-395(in Chinese).
[20]  李战怀,王国仁,周傲英.从数据库视角解读大数据的研究进展与趋势[J].计算机工程与科学,2013,35(10):1-11. Li Zhanhuai,Wang Guoren,Zhou Aoying.Research progress and trends of big data from a database perspective[J].Computer Engineering & Science,2013,35(10):1-11(in Chinese).
[21]  Viktor M S,Keneth C.Big data:A revolution that will transform how we live,work,and think[M].Zhejiang:Zhejiang People's Publishing House:2013:2-5,39(in Chinese).
[22]  舒印彪,汤涌,孙华东.电力系统安全稳定标准研究[J].中国电机工程学报,2013,33(25):1-8. Shu Yinbiao,Tang Yong,Sun Huadong.Research on power system security and stability standards[J].Proceedings of the CSEE,2013,33(25):1-8(in Chinese).
[23]  舒印彪,张文亮,周孝信,等.特高压同步电网安全性评估[J].中国电机工程学报,2007,27(34):1-6. Shu Yinbiao,Zhang Wenliang,Zhou Xiaoxin,et a1.Security evaluation of UHV synchronized power grid[J].Proceedings of the CSEE,2007,27(34):1-6(in Chinese).
[24]  邢浩江,张东来.电力采集系统故障时刻精度的提高方法[J].中国电机工程学报,2011,31(16):88-95. Xing Haojiang,Zhang Donglai.Improvement on fault time accuracy of power sampling system[J].Proceedings of the CSEE,2011,31(16):88-95(in Chinese).

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133