I need to build a fail safe pipeline where In case the pipeline is stopped abruptly due to some issue on the VM side or the SDC, There needs to be a safe exit.
The batch it was working on should not be lost or partial data should not be written.
When restarted I need to make sure it does not start from the 1st batch again but needs to pick up from where it left off.
What does streamsets have to deal with problem like this??