Apache Spark and Amazon EMR Quiz

What is the main advantage of Apache Spark over Apache Hadoop?

• Disk-based processing

• In-memory processing

• Limited compatibility with other frameworks

• Sequential data processing

Which component in Spark is responsible for handling cached data across operations?

• DataFrames

• Executors

• Spark SQL

• SparkContext

Which Spark component provides a distributed query engine for faster data processing?

• Spark GraphX

• Spark Streaming

• Spark SQL

• Spark Core

What function does Spark Streaming serve in the Spark framework?

• Batch processing

• In-memory data caching

• Real-time streaming analytics

• Distributed machine learning

Spark MLlib is a library primarily used for:

• Query optimization

• Machine learning at scale

• Graph processing

• Real-time data streaming

Which Spark component supports graph processing and transformation?

• Spark SQL

• Spark GraphX

• Spark MLlib

• Spark Streaming

What is the role of the SparkContext object in Spark?

• Managing memory

• Distributing tasks to executors

• Storing results

• Handling SQL queries

What does 'upsert' mean in data management?

• Update or insert data if it doesn’t exist

• Delete or update existing data

• Replace data with older versions

• Save data in multiple formats

Amazon EMR is best described as:

• An in-memory processing engine

• A data management framework for small data

• A managed cluster platform for big data frameworks

• A serverless data warehouse

Which Amazon EMR node type stores data in HDFS and performs tasks?

• Main node

• Core node

• Task node

• None of the above