WorksheetsApache Hadoop and Spark Quiz
Total questions: 18
Worksheet time: 9mins
Which of the following components is NOT a part of the Apache Hadoop ecosystem?
Hive
Pig
ZooKeeper
HBase
What is the default block size for HDFS in Apache Hadoop?
128 MB
64 MB
256 MB
512 MB
Which of the following is a benefit of using Apache Spark over Hadoop MapReduce?
Lower cost
In-memory processing
More languages supported
Easier to install
What is the maximum item size in Amazon DynamoDB?
400 KB
1 MB
200 KB
2 MB
Point out the correct statement.
Spark enables Apache Hive users to run their unmodified queries much faster.
Spark interoperates only with Hadoop.
Spark is a popular data warehouse solution running on top of Hadoop.
All of the above
Match the correct description of Apache Spark components and features:
A feature where transformations in Spark are not evaluated until you trigger an action - Lazy execution
A program that declares the transformation and action on the data RDDs - Driver
An optimization framework allows Spark to automatically transform SQL queries by adding new optimizations to build a faster processing system - Catalyst framework
An operation used to re-distribute data across multiple partitions. It runs an operation on all elements of all partitions - Shuffle
Any node that runs the application code in the Spark cluster - Worker
When you increase the number of files stored in HDFS, the memory required by NameNode:
Increases
Decreases
Remains unchanged
May increase or decrease
Most NoSQL databases support automatic ________, meaning that you get high availability and disaster recovery.
Processing
Scalability
Replication
All of the above
Which of the following statements is TRUE of NoSQL databases?
They don't support any Structured Query Language (SQL).
They are useful for managing large sets of distributed data.
They are the most commonly used databases today.
They cannot be used in conjunction with relational databases.
In Amazon EMR, what is the function of an EMR Cluster?
Data storage
Data coordination
Data processing
Data encryption
In ZooKeeper, what does the term "Znode" refer to?
A ZooKeeper instance
A data node in ZooKeeper's hierarchical model
A data encryption method
A user of ZooKeeper
What does EMR stand for in Amazon EMR?
Elastic MapReduce
Elastic MasterReduce
Extended MapReduce
Elastic Machine Runtime
Which component is placed on top of Spark Core?
Spark Streaming
Spark SQL
RDDs
None of the above
What language is NOT supported by Apache Spark for application development?
Python
Java
C#
Scala
In a MapReduce job, which step comes last?
Shuffle
Map
Sort
Reduce
Which mechanism is most appropriate for "Distributed coordination service with a reliable leader node"?
ZooKeeper
HDFS
HBase
Paxos
Which of the following is NOT a benefit of using Amazon EMR?
Scalability
Low cost
Real-time processing
Easy to use
As compared to RDBMS, Apache Hadoop:
Has higher data integrity
Does ACID transactions
Works better on unstructured and semi-structured data
Is suitable for read and write many times
