Pinboard (jm)
https://pinboard.in/u:jm/public/
recent bookmarks from jmHandling GDPR: How to make Kafka Forget2017-12-05T23:05:40+00:00
http://www.benstopford.com/2017/12/04/handling-gdpr-make-kafka-forget/
jmHow do you delete (or redact) data from Kafka? The simplest way to remove messages from Kafka is to simply let them expire. By default Kafka will keep data for two weeks and you can tune this as required. There is also an Admin API that lets you delete messages explicitly if they are older than some specified time or offset. But what if we are keeping data in the log for a longer period of time, say for Event Sourcing use cases or as a source of truth? For this you can make use of Compacted Topics, which allow messages to be explicitly deleted or replaced by key.
Similar applies to Kinesis I would think.]]>kafka kinesis gdpr expiry deleting data privacyhttps://pinboard.in/https://pinboard.in/u:jm/b:7e063febc6e6/