Table of Contents
Introduction to Parallel Processing
Overview and Goals of Parallel Processing
PPT Slide
Scalable parallel
Efficiency Curve
Goals of Parallel Computing
Why Use Parallel Processing to Reach These Goals?
Taxonomy of Architectures
Single Instruction, Single Data (SISD)
Multiple Instruction, Single Data (MISD) Here for completeness only
Single Instruction, Multiple Data (SIMD)
Single Instruction, Multiple Data (SIMD)
Single Instruction, Multiple Data (SIMD)
MIMD (Multiple Instruction, Multiple Data)
MIMD (Multiple Instruction, Multiple Data)
MIMD (Multiple Instruction, Multiple Data)
PPT Slide
Terminology of Parallelism
Synchronization
Observed Speedup
Latency and Bandwidth
Parallel Overhead
Granularity
Course vs. Fine Graining
PPT Slide
SPMD
MIMD and SPMD
PPT Slide
PPT Slide
Distributed memory machines
Communication - Message Passing
Message Passing
Message Passing
Message Passing
Dependency Analysis
Domain Decomposition
Granularity
Granularity
Two methods of Decomposition
Functional Parallism
Functional Parallelism
PPT Slide
PPT Slide
PPT Slide
Data Parallelism
PPT Slide
PPT Slide
PPT Slide
PPT Slide
When to Use Data Parallelism
Costs of Parallel Processing
Converting From Serial to Parallel Execution
PPT Slide
PPT Slide
PPT Slide
PPT Slide
PPT Slide
PPT Slide
PPT Slide
I/O
PPT Slide
PPT Slide
Newark SRAC
New Brunswick SRAC
Supercomputing Resources
NCSA
Starter Grants at NCSA
Starter Grants at SDSC
Addition Information on Parallel Computing
|