Topic Spider with Postgresql Datebase Cluster
Postgresql数据库集群在主题网络爬虫的应用

In respect to the characteristics of hugeness of net information and request for spider efficiency in topic net, this paper applies postgresql database cluster to the topic net spider, meets the need for huge storage space by spider, and also tackled the bottleneck of efficiency with cache technology when the cluster technology is applied in spider..