Granularity
Granularity: refers to the amount of computation done in parallel relative to the size of the whole program.
Fine-grained: tasks are relatively small. This results in more frequent communication being required among processors relative to the amount of computational work done.
Coarse-grained: tasks are relatively large. Much computational work is done between synchronizations.