SPMD
Single Program Multiple Data
Code is the same on all processors
most scalable if all processors read/write to files
hybrid SPMD-I/O done by one processor
Scalability: Communication
regular communications are more scalable
balanced, predictable communication pattern
keeps cost constant as number of processors grow