Granularity
A consideration in decomposing a problem is granularity.
- shorter duration between communication
- allows better opportunity for load balancing with less
delays waiting for last piece to finish
- longer duration between communication
- allows less communication and potentially a longer
wait for last piece to finish.