WorksheetsHadoop Ecosystem Fundamentals: MapReduce, Pig, Hive Basics
Total questions: 40
Worksheet time: 20mins
MapReduce focuses on ________, while Hive focuses on ________.
Real-time processing; Batch analytics
Batch processing; Data warehousing and querying
Data visualization; ETL operations
Data streaming; File storage
Which Hadoop component provides a high-level abstraction over MapReduce jobs?
Pig and Hive
YARN and HDFS
HBase and Sqoop
Oozie and Flume
Pig Latin scripts are internally converted into:
HiveQL queries
MapReduce jobs
SQL queries
NoSQL tables
MapReduce handles data at the ______ level, while Hive manages it at the ______ level.
Record; Table
File; Block
Job; Cluster
Node; Directory
Which one is declarative in nature?
MapReduce
Pig Latin
HiveQL
Both B and C
Pig is mainly designed for _______, whereas MapReduce is for _______.
Simple queries; complex operations
ETL operations; custom logic
OLTP systems; OLAP systems
Data transfer; resource management
In Hive, every query is internally executed as:
SQL job
MapReduce job
Spark job
Shell command
Which of the following allows schema-on-read processing?
MapReduce only
Hive and Pig
HBase
YARN
The shuffle and sort process in MapReduce is conceptually similar to which phase in Hive?
Query optimization
Data grouping and aggregation
File loading
Schema definition
MapReduce’s Combiner function is similar to which operation in Hive?
GROUP BY
ORDER BY
DISTINCT
JOIN
Which component of Hadoop handles job scheduling and resource management?
JobTracker
YARN
Hive Driver
Pig Compiler
Hive and Pig both rely on which Hadoop component for execution?
HDFS
YARN
MapReduce
All of the above
In MapReduce, data is divided into:
Tables
Input Splits
Column Families
Records
In HBase, data is stored in:
Rows and Columns
Key-Value pairs
Column Families and Qualifiers
All of the above
Which tool among the following is a NoSQL database?
Hive
Pig
HBase
MapReduce
The ResourceManager in YARN is analogous to which component in classic MapReduce?
NameNode
JobTracker
TaskTracker
DataNode
Hive Metastore stores:
Data files
Table schemas and metadata
HDFS block information
Reducer output
Pig and Hive differ mainly in that:
Pig is procedural; Hive is declarative
Pig is declarative; Hive is procedural
Pig uses SQL; Hive uses JSON
Pig runs on Spark; Hive runs on HDFS
MapReduce processes are written in:
SQL
Java or Python
Pig Latin
Shell scripts
Hive and Pig were both developed to:
Simplify MapReduce programming
Replace HDFS
Manage data nodes
Monitor Hadoop clusters
In MapReduce, Mapper output is stored:
Temporarily on local disk
Directly in HDFS
In Hive tables
In the Pig Engine
The Reducer stage in MapReduce is equivalent to which SQL operation?
SELECT
GROUP BY / AGGREGATE
UPDATE
INSERT
In Pig, the "FOREACH" statement is similar to which MapReduce component?
Mapper
Reducer
Combiner
JobTracker
In Hive, "INSERT OVERWRITE" corresponds to which MapReduce phase?
Shuffle and Sort
Final Output Writing
Map Phase
Split Phase
HBase differs from Hive in that HBase provides:
Real-time read/write access
Batch SQL querying
Text analytics
Job scheduling
MapReduce is process-oriented, while Hive and Pig are:
Data-oriented
Cluster-oriented
Job-oriented
Schema-oriented
Which tool is best suited for ETL operations?
Hive
Pig
HBase
MapReduce
Hive’s query execution engine interacts with:
YARN
HDFS
Metastore
None of the above
In a typical Hadoop ecosystem, MapReduce handles which responsibility?
Processing
Storage
Query execution
Data modeling
Pig Latin is easier to use than MapReduce primarily because:
It has GUI
It uses fewer lines of code
It is compiled in Java
It stores results in JSON
HBase is typically used when:
Data is structured and static
Fast, random read/write operations are needed
Data is small
SQL queries are required
Hive is most suitable for:
Online Transaction Processing (OLTP)
Online Analytical Processing (OLAP)
Real-time streaming
File transfers
MapReduce and YARN together form the:
Hadoop Execution Framework
Hadoop Storage Layer
Hadoop Management System
HBase Engine
Pig’s DUMP command corresponds to which step in MapReduce?
OutputFormat write
Map phase
Combiner
Job initialization
In Hive, CREATE TABLE corresponds to which MapReduce function?
InputFormat definition
Reducer aggregation
Shuffle setup
Job scheduling
Which of the following is not directly dependent on MapReduce?
Hive
Pig
HBase
None of the above
Which component can connect Hive to HBase?
Hive-HBase Handler
Hive Metastore
Pig Engine
JobTracker
MapReduce can fail due to which of the following?
Node failure
Network bottlenecks
Data corruption
All of the above
Which tool is mainly procedural and used for data transformation?
Hive
Pig
HBase
YARN
When comparing MapReduce and Hive, Hive is:
Faster for large-scale iterative jobs
Slower but easier to use
Real-time oriented
Built for stream processing
