Apache Kafka - Real-time Stream Processing (Master Class) - Real-time Streaming Challenges

The lecture discusses the challenges of real-time stream processing, focusing on event modeling, transportation, and processing. It explains that event modeling involves data and process modeling, not technical issues, and provides examples of event representation using JSON, Avro, or XML. The lecture highlights the complexity of streaming events from multiple sources to multiple destinations, using a retail system as an example. It evaluates using databases to simplify event transportation and decouple producers and consumers. The lecture concludes by suggesting further evaluation of streaming options based on decision criteria.

How does placing a database in between producers and consumers simplify the event transportation problem?

What are the potential alternatives to using databases for streaming data or events?

What is the main goal of the next lecture as mentioned in the text?