Parallel Computing Environments: A Review

This article presents a review of various hardware and software parallel computing environments so far developed for the implementation of parallel algorithms to solve complex and computationally dominated optimization problems. These parallel environments are composed of parallel programming tools, performance evaluation tools, debuggers and optimization libraries. The environments can be classified based on the ease of implementation, hardware independence, ease to understand, and guarantee of performance.