I have numerous Kafka topics that I’m moving to Databricks, but I don’t want the pipelines to continuously run. Is there a way that I can schedule a pipeline to run for a certain amount of time or trigger it to stop after a certain amount of time...say an hour or 2?
Best answer by saleempothiwala
View original