Apache Kafka - Real-time Stream Processing (Master Class) - Timestamps and Timestamp Extractors

The video tutorial explains how to compute aggregates on streams using time-based windows. It discusses the importance of choosing the right time stamp, such as event time, producer time, or ingestion time, for accurate stream processing. The tutorial also covers how to configure these time stamps in Kafka, emphasizing the use of custom timestamp extractors for event time and the wall clock extractor for processing time.

Why is it more meaningful to compute aggregates in time-based windows rather than continuously growing totals?

• It simplifies the computation process.

• It reduces the amount of data to process.

• It eliminates the need for timestamps.

• It provides more relevant insights over specific periods.

What is the primary challenge when dealing with multiple timestamps for the same event?

• Storing all timestamps in the event metadata.

• Converting timestamps to a common format.

• Ensuring all timestamps are identical.

• Deciding which timestamp to use for processing.

What is the best alternative for timestamping when the event does not have its own timestamp?

• Ignoring the timestamp altogether.

• Relying on the network time.

• Using the producer API to add a timestamp.

• Using the system clock time.

What is the ingestion time in Kafka?

• The time when the event is created.

• The time when the event reaches the Kafka broker.

• The time when the event is processed by the application.

• The time when the event is sent by the producer.

How can you configure Kafka to use processing time for timestamping?

• By using a custom timestamp extractor.

• By configuring the wall clock timestamp extractor.

• By using the producer API timestamp.

• By setting the log append time at the topic level.

Which timestamp extractor should be used to simulate event time using producer timestamps?

• Metadata timestamp extractor.

• System clock timestamp extractor.

• Custom timestamp extractor.

• Wall clock timestamp extractor.

What is the role of a custom timestamp extractor in Kafka?

• To overwrite existing timestamps with a new one.

• To extract the created time from the message body.

• To read timestamps from the record metadata.

• To extract the current system time.