Goals of Parallel Computing
1. Reduce Wall Clock Time
wall clock time not CPU time
2. Cheapest Possible Solution Strategy
many workstations cost much less then a large mainframe-style
processors should be “close” to one another in terms of communication
the more communication latency incurred the longer it will run
As researcher becomes more sophisticated, the complexity of problems
they tackle increases proportionally. One of the first resources to get
exhausted is local memory. Distributed memory helps alleviate