NEW
Font size
WorksheetsMCQs on Big Data Analytics
Total questions: 25
Worksheet time: 13mins
The main goal of MapReduce is to:
Scale vertically by upgrading hardware
Simplify distributed data processing
Replace relational databases
Provide encryption for data
The "Word Count" program in MapReduce produces:
Total number of characters
List of words and their occurrence counts
Sentence length analysis
Document similarity scores
Which company originally described the MapReduce paradigm?
Yahoo
IBM
Hadoop's implementation of MapReduce is primarily written in:
Python
Java
Scala
C++
Which distributed filesystem is used by Hadoop?
FAT32
NTFS
HDFS
ZFS
Which of the following is a user component of MapReduce?
Input Splitter
Master
Mapper
Output Committer
The default input split size in Hadoop MapReduce is:
16 MB
32 MB
64 MB
128 MB
The reducer ensures that:
All outputs are encrypted
Keys are distributed randomly
All values with the same key go to the same reducer
Each key is assigned to multiple reducers
Which component reduces the output of each mapper before sending it to reducers?
Combiner
Input Splitter
Partitioner
Master
The default partitioner uses:
Random assignment
Round-robin distribution
Key.hashCode() % number_of_reducers
Key length
The input splitter divides data into:
Random chunks
64MB logical boundaries by default
1MB files
Variable-sized packets
Mapper input and output are represented as:
XML documents
JSON objects
Tables
In the Word Count example, the Mapper emits:
Reducer's main role is to:
Filter invalid keys
Collect and aggregate values by key
Compress the outputs
Distribute tasks
The output committer is responsible for:
Scheduling tasks
Splitting inputs
Writing reducer results to files
Monitoring tasks
If a mapper fails during execution, the framework:
Stops the entire job
Restarts the job from the beginning
Kills the task and re-runs it with the same input
Ignores the failed task
The master schedules computations:
Far from the data
Randomly across nodes
As close to the data as possible
Based on user preference
Which tool allows workflows as Directed Acyclic Graphs (DAGs)?
Hive
Oozie
Pig
Sqoop
In matrix-vector multiplication using MapReduce, the mapper emits:
Before running a MapReduce job, if the output folder already exists in HDFS, you must:
Rename it
Overwrite it directly
Remove it using hdfs dfs -rm -r
Move it to another directory
In the runtime coordination phase, which component logs job details like ID and submission time?
NodeManager
ResourceManager
JobHistoryServer
ApplicationMaster
During task execution, shuffle and sort ensure that:
Keys are grouped together before reducing
Data is compressed
All outputs are encrypted
Inputs are concatenated
NodeManagers send ______ to ResourceManager to confirm task status.
Requests
Heartbeats
Counters
Snapshots
In Hadoop + Spark integration, MNIST dataset is stored in HDFS in which format?
CSV
NPZ
TXT
JSON
In the MNIST example, the PySpark ML pipeline trains which model?
Decision Tree
Logistic Regression
Random Forest
K-Means
