Skip to main content

What's the difference between a job and a pipeline?

  • January 14, 2022
  • 0 replies
  • 1488 views

hrecker
StreamSets Employee
  • StreamSets Employee
  • 3 replies

A pipeline describes the flow of data from the origin system to destination systems and defines how to transform the data along the way.

A job is the execution of a pipeline. A job instance defines the pipeline to run and the engine that runs the pipeline. Pipeline is like a java class and job is the instance of the class.

0 replies

Be the first to reply!

Reply