Hadoop Streaming

What is Hadoop Streaming?

• A Hadoop service for running real-time streaming applications

• A utility to run MapReduce jobs using non-Java programs

• A tool to process real-time data in Hadoop

• A feature for managing Hadoop clusters

Which command is used to execute a Hadoop Streaming job?

• hadoop mapreduce

• hadoop streaming

• hadoop jar

• hadoop run

Which languages can be used for Hadoop Streaming?

• Only Java

• Python and Java

• Any language that can read/write to standard input/output

• Only Python

What is the role of the Mapper in Hadoop Streaming?

• To process input data and generate key-value pairs

• To merge and sort the data

• To combine multiple reducers

• To store the final output

What is the role of the Reducer in Hadoop Streaming?

• To split large files into smaller ones

• To store processed data in HDFS

• To aggregate and process intermediate key-value pairs

• To distribute data across clusters

In the Hadoop Streaming command, what does the -mapper option specify?

• The reducer script

• The input data format

• The script that processes input data line by line

• The script that processes grouped key-value pairs

In the Hadoop Streaming command, what does the -reducer option specify?

• The script that processes the mapper's output

• The script that stores the output

• The script that splits large files

• The script that defines the number of tasks

How does Hadoop Streaming handle input and output data?

• Using HDFS only

• Through standard input (stdin) and standard output (stdout)

• Using a database connection

• By writing directly to local file systems

What is the default number of reducers in Hadoop Streaming if not specified?

• 0

• 1

• 2

• Based on the number of mappers

How do you specify a custom number of reducers in a Hadoop Streaming job?

• -numReducers <number>

• -reducers <number>

• -numReduceTasks <number>

• -reduceTasks <number>