I have a pipeline using the Kafka multi-topic consumer as the origin and ultimately writing to Databricks. How do I handle processing tombstone messages from Kafka? I’m getting the following error from the origin for those records:
KAFKA_74 - Tombstone message: payload is null
Is there a connection configuration property or something that will allow these records to be processed?