Parallel Computing Quiz

Serial computing means:

• Running multiple instructions concurrently

• Executing one instruction at a time on one processor

• Using distributed nodes to compute

• Executing loops in parallel

Parallel computing is best characterized by:

• Using a GPU only

• Breaking a problem into parts solved simultaneously across resources

• Running multiple threads sequentially

• Using a single-core machine

Data parallelism involves:

• Different tasks on same data

• Same task performed on different data chunks

• Asynchronous messaging

• Thread-level speculation

Task parallelism means:

• Dividing data evenly

• Assigning different tasks to different processors

• SIMD vector ops

• GPU offloading exclusively

Which taxonomy describes SIMD, MIMD, etc.?

• Gustafson's

• Flynn's

• Amdahl's

• KarpUpfal

SISD stands for:

• Single Instruction Single Data

• Simultaneous Intrashared Data

• Single Instance Shared Data

• Single Iteration Single Domain

MIMD refers to:

• Multiple instructions on multiple data streams

• Single instructions multiple data

• Multiple threads on same CPU

• GPU-specific parallelism

A sharedmemory system:

• Has separate memory per processor

• Requires message passing

• Allows threads to access one global address space

• Is always distributed

In distributed memory, communication happens via:

• Shared variables

• Cache coherence

• Message passing between processors

• Uniform access latency

Hybrid architectures combine:

• Two CPUs only

• Shared and distributed memory models

• Only GPU and CPU

• Singlethread execution