Introduction to Parallel Processing

6/7/97


Click here to start


Table of Contents

Introduction to Parallel Processing

Overview and Goals of Parallel Processing

PPT Slide

Scalable parallel

Efficiency Curve

Goals of Parallel Computing

Why Use Parallel Processing to Reach These Goals?

Taxonomy of Architectures

Single Instruction, Single Data (SISD)

Multiple Instruction, Single Data (MISD) Here for completeness only

Single Instruction, Multiple Data (SIMD)

Single Instruction, Multiple Data (SIMD)

Single Instruction, Multiple Data (SIMD)

MIMD (Multiple Instruction, Multiple Data)

MIMD (Multiple Instruction, Multiple Data)

MIMD (Multiple Instruction, Multiple Data)

PPT Slide

Terminology of Parallelism

Synchronization

Observed Speedup

Latency and Bandwidth

Parallel Overhead

Granularity

Course vs. Fine Graining

PPT Slide

SPMD

MIMD and SPMD

PPT Slide

PPT Slide

Distributed memory machines

Communication - Message Passing

Message Passing

Message Passing

Message Passing

Dependency Analysis

Domain Decomposition

Granularity

Granularity

Two methods of Decomposition

Functional Parallism

Functional Parallelism

PPT Slide

PPT Slide

PPT Slide

Data Parallelism

PPT Slide

PPT Slide

PPT Slide

PPT Slide

When to Use Data Parallelism

Costs of Parallel Processing

Converting From Serial to Parallel Execution

PPT Slide

PPT Slide

PPT Slide

PPT Slide

PPT Slide

PPT Slide

PPT Slide

I/O

PPT Slide

PPT Slide

Newark SRAC

New Brunswick SRAC

Supercomputing Resources

NCSA

Starter Grants at NCSA

Starter Grants at SDSC

Addition Information on Parallel Computing

Author: Janet Salowe

Email: salowe@nbcs.rutgers.edu