pause and resume the job from where we left off

  • 15 February 2022
  • 1 reply

we are using multithreading for ingesting bulk data from source using databricks notebook. we are running the notebooks as a job. we have a requirement like pausing the job and resuming the job from where it left off previously(since we can only ingest at particular time).wanted to know how to run the databricks notebook job to pause at certain time and resume it from where it had left off previously instead of starting from the scratch again.



1 reply

Userlevel 5

Hi @harshith Moving your question to the “Got a Question?” Category as this doesn't look like an StreamSets Academy specific question.