Big Data Processing Quiz

What is the size of the Google Search index?

• 10 exabytes

• 100 exabytes

• 1 zettabyte

• 1 petabyte

In the context of k-Means as a MapReduce operation, what does the Reduce function do?

• Calculates new centroids of points

• Chooses initial means

• Splits data into partitions

• Orchestrates the entire process

What is Hadoop primarily designed for in the context of big data?

• Sequential processing

• Parallel computing with MapReduce

• Data visualisation

• Machine learning algorithms

Which component of Hadoop is responsible for managing resources and scheduling task execution?

• Hadoop Common

• MapReduce

• HDFS

• YARN

What is the main purpose of Resilient Distributed Datasets (RDDs) in Apache Spark?

• To manage resources and schedule task execution

• To recover from node failures

• To perform distributed SQL queries

• To store application data in distributed and replicated form

What is the main purpose of Spark Core in Apache Spark?

• Scalable machine learning interface

• Performing graph-based operations

• Working with RDDs

• SQL querying capabilities

What is the primary advantage of using Apache Spark for data processing?

• Ability to run only on Hadoop clusters

• Dependency on specific programming languages

• Capability to run locally or on a cluster

• Integration with limited Big Data systems

What is the main purpose of Directed Acyclic Graphs (DAGs) in Apache Spark?

• To manage parallel execution of a job

• To store tabular data

• To perform machine learning tasks

• To interact with data streams

What is the key idea behind RDDs in Apache Spark?

• Mutable data structure

• Write applications in terms of transformations

• Sequential data processing

• Synchronization between partitions

What does a Spark DAG (Directed Acyclic Graph) represent?

• • Circular flow of data

• • Network of nodes with loops

• • Parallel execution of a job

• • Sequential execution plan