Log Cleanup Policies

The video tutorial introduces the concept of log cleanup in Kafka, explaining how data expiration is managed through policies. The default policy for user topics is 'delete', which removes data based on age and size. Another policy, 'compact', is used for consumer offsets, deleting duplicate keys. Log cleanup helps manage disk space and system performance, occurring when partition segments are committed. The frequency of cleanup is balanced to optimize resource use.

What is the default log cleanup policy for user topics in Kafka?

• Compact

• Delete

• Retain

• Archive

How does the 'compact' policy manage data in Kafka?

• Retains all data indefinitely

• Deletes data based on age

• Deletes data based on size

• Deletes duplicate keys after segment commitment

What is the primary benefit of log cleanup in Kafka?

• Reduces disk usage and maintenance

• Increases data redundancy

• Improves data retrieval speed

• Enhances data encryption

How often does the log cleaner check for cleanup in Kafka?

• Every 20 seconds

• Every 15 seconds

• Every 10 seconds

• Every 5 seconds

What is a potential downside of frequent log cleanup?

• Data loss

• Higher CPU and RAM usage

• Increased data redundancy

• Slower data retrieval