WorksheetsBigData-Hadoop
Total questions: 20
Worksheet time: 10mins
What are the main components of Hadoop Ecosystem?
MapReduce, HDFS, YARN
MLlib, GraphX
Gelly, Table, CEP
None of the mentioned
________________is a resource management platform responsible for managing compute resources in the cluster and using them in order to schedule users and applications.
Hadoop Common
Hadoop Distributed File System (HDFS)
Hadoop YARN
Hadoop MapReduce
Which of the following tool is designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases.
Apache Sqoop
Pig
Mahout
Flume
Consider the following statements:
Statement 1: The Job Tracker is hosted inside the master and it receives the job execution request from the client.
Statement 2: Task tracker is the MapReduce component on the slave machine as there are multiple slave machines.
Only statement 1 is true
Only statement 2 is true
Both statements are true
Both statements are false
_____________is the slave/worker node and holds the user data in the form of Data Blocks.
NameNode
DataNode
Data block
Replication
The number of maps in MapReduce is usually driven by the total size of________________
Inputs
Outputs
Tasks
None of the mentioned
_______________function processes a key/value pair to generate a set of intermediate key/value pairs.
Map
Reduce
Both Map and Reduce
None of the mentioned
True or False ?
The main duties of task tracker are to break down the receive job that is big computations in small parts, allocate the partial computations that is tasks to the slave nodes monitoring the progress and report of task execution from the slave.
True
False
Point out the correct statement in context of YARN:
YARN extends the power of Hadoop to incumbent and new technologies found within the data center
YARN is highly scalable
YARN enhances a Hadoop compute cluster in many ways
All of the mentioned
Apache Hadoop YARN stands for:
Yet Another Reserve Negotiator
Yet Another Resource Network
Yet Another Resource Negotiator
Yet Another Resource Manager
For which of the following operations is NO communication with the NameNode required?
A client writing a file to HDFS.
A client requesting the filename of a given block of data.
A client reading a block of data from the cluster.
A client reading a file from the cluster.
Which of the following components reside on a NameNode?
Filenames, blocks and checksums
Blocks and heartbeat messages
Filenames, block locations
Blocks and block locations
Which of the following statements are true about key/value pairs in Hadoop?
A map() function can emit up to a maximum number of key/value pairs (depending on the Hadoop environment).
A map() function can emit anything between zero and an unlimited number of key/value pairs.
A reduce() function can iterate over key/value pairs multiple times.
A call to reduce() is guaranteed to receive key/value pairs from only one key.
A ________ serves as the master and there is only one NameNode per cluster.
Data Node
NameNode
Data block
Replication
HDFS works in a __________ fashion
master-worker
master-slave
worker/slave
worker/master
________ NameNode is used when the Primary NameNode goes down.
Rack
Data
Secondary
Name
The need for data replication can arise in various scenarios like ____________
Replication Factor is changed
DataNode goes down
Data Blocks get corrupted
All of the mentioned
HDFS is implemented in _____________ programming language.
Scala
C++
Java
C
________ is a programming model designed for processing large volumes of data in parallel by dividing the work into a set of independent tasks.
Hive
MapReduce
Pig
Lucene
Output of the mapper is first written on the local disk for sorting and _________ process.
shuffling
secondary sorting
forking
reducing
