|
计算机科学 2011
Research on Dynamic Job Configuration Framework for Mining of Software Repositories
|
Abstract:
Construction of datacenters for mining of software repositories(MSR) is a hot topic in current software enginecring area. Data processing jobs for software repositories arc highly diverse in execution-time and resourccconsuming, which bring many challenges for the job configuration in such environments. This paper proposed a job configuralion framework named TrustieSDC for mining of software repositories. TrustieSDC supports a new paradigm for remote deployment and execution of MSR jobs,and proposes a software-subversion-partition based job configuration algorithm to cut the response time of long jobs and increase the resource utilization. The experiments based on SVN repositories of Gnome projects shows that compared with paralleled Alithcia system, TrustieSDC gains remarkable improvement on both performance and resource utilization.