Midterms - Parallel and Distributed Computing

What is fault tolerance in distributed systems?

• The avoidance of faults or failures

• The system's ability to continue functioning despite faults or failures

• The elimination of distributed components

• The prevention of tasks running concurrently

What communication model is common in cluster computing and inter-process communication?

• Remote Procedure Call (RPC)

• Publish-Subscribe

• Message Passing

• Scalability

What is concurrency in distributed systems?

• The isolation of tasks on different machines

• The execution of multiple tasks or processes simultaneously on different machines

• The sequential execution of tasks on the same machine

• The avoidance of parallel execution

In the context of parallel computing, what does "Concurrency Control" refer to?

• Efficient resource utilization

• Managing concurrent processes

• Handling big data

• Load balancing

Which subtopic involves distinguishing between parallel computing and distributed computing?

• Task Parallelism

• Differentiating between Parallel and Distributed Computing

• Shared Memory Systems

• Fault Tolerance and Reliability

Why are SIMD architectures and vectorization crucial for computer science students?

• They only benefit graphics rendering tasks

• They are irrelevant to parallel processing

• They optimize code for parallel execution, improving performance

• They slow down computational throughput

What is one of the key reasons for studying Parallel and Distributed Computing?

• Historical interest

• Reducing individual task complexity

• Handling big data

• Enhancing personal communication

Why is understanding fault tolerance and reliability important in parallel and distributed computing?

• For improving programming efficiency

• To enhance system resilience

• To reduce system load

• For optimizing software performance

Which of the following is an example of a Shared Memory architecture?

• Clusters of computers connected over a network

• Symmetric Multiprocessing (SMP) systems

• Graphics Processing Units (GPUs)

• Message Passing Interface (MPI)

The rise of big data refers to:

• Decrease in data volume

• Reduction in data variety

• Exponential growth in data volume, variety, and velocity

• Stagnation of data processing tasks