|
|
- 2016
一种均衡视频资源的分布存储方法
|
Abstract:
摘要 随着互联网视频内容日益增多，视频资源的分布式存储受到关注.在分布式存储系统中，如果文件能均衡存储在各个节点会使系统更加健壮，而传统的分布式存储系统通常在失衡发生后再调整，带来了较多的IO开销.对分布式视频文件存储进行研究，提出一种利用哈希和Bloom Filter的高性能存储系统HBF，在文件存入系统时即进行存储平衡.系统具备多个节点，文件分散保存在不同的节点上，系统通过增加或删除节点使容量具备可伸缩性，而且在存储平衡方面进行了改进，使存储节点之间的存储使用量保持相对一致.实验证明，HBF使分布式视频文件存储系统具有高性能并兼顾节点存储平衡，有利于负载均衡和资源的合理利用.
| [1] | Karger D, Lehman E, Leighton T, et al. Consistent hashing and random trees:distributed caching protocols for relieving hot spots on the World Wide Web[C]//Proceedings of the Twenty-Ninth Annual ACM Symposium on the Theory of Computing. 1997:654-663. |
| [2] | Zhao N, Wan J, Wang J, et al. GreenCHT:a power-proportional replication scheme for consistent hashing based key value storage systems[C]//Mass Storage Systems and Technologies (MSST), 201531st Symposium on. 2015:1-6. |
| [3] | Bloom B H. Space/time trade-offs in hash coding with allowable errors[J]. Communications of the ACM, 2010, 13(7):422-426. |
| [4] | Qiao Y, Li T, Chen S. Fast bloom filters and their generalization[J]. IEEE Transactions on Parallel & Distributed Systems, 2014, 25(1):93-103. |
| [5] | Maccormick J, Murphy N, Ramasubramanian V, et al. Kinesis:a new approach to replica placement in distributed storage systems[J]. ACM Transactions on Storage (TOS), 2009, 4(4):1-28. |
| [6] | 王君君. 网络文件的分布式存储设计与实现[D]. 济南:山东大学,2015. |
| [7] | Decandia G, Hastorun D, Jampani M, et al. Dynamo:amazon's highly available key-value store[J]. ACM Sigops Operating Systems Review, 2007, 41(6):205-220. |
| [8] | Wang Z, Luo C, Luo T, et al. A bloom filter-based index for distributed storage systems[C]//Distributed Computing and Artificial Intelligence, 12th International Conference. Springer International Publishing, 2015:293-301.</p> |
| [9] | Weil S A, Brandt S A, Miller E L, et al. CRUSH:controlled, scalable, decentralized placement of replicated data[C]//SC 2006 Conference, Proceedings of the ACM/IEEE. IEEE, 2006:31-43. |
| [10] | Sun B J, Wu K J. Research on cloud computing application in the peer-to-peer based video-on-demand systems[C]//Intelligent Systems and Applications (ISA), 20113rd International Workshop on. IEEE, 2011:1-4. |
| [11] | <p> Wang Z, Luo T. Intelligent video content routing in a direct access network[C]//Symposium on Web Society. 2011:147-152. |
| [12] | Hou J, Luo T, Wang Z, et al. An intelligent media delivery prototype system with low response time[C]//Advances in Swarm and Computational Intelligence. Springer International Publishing, 2015:253-264. |
