Question

How to send status of job/pipeline as message to Amazon SNS topic?

  • 27 October 2022
  • 2 replies
  • 31 views

Hi everyone,

Has anyone found a way to send status of job/pipeline as message to Amazon SNS topic?


2 replies

Userlevel 4
Badge

@Mafkereseb ,

 

You can use REST API to get job status:
 

 

Here you can see that the job is INACTIVE and color is GRAY, also errorRecordCount = 0 and errorMessage = null so that means the job finished successfully.

You can create a generic pipeline that reads status for any job_id and generates a notification in SNS using the Publish API.

Userlevel 4
Badge

@Mafkereseb you could also set up PipelineFinisher/Stop Event in your pipelines that writes the status to a database table. 

Another pipeline that polls this table so as soon as it gets a new row, invoke API to publish it to your SNS topic. 

Reply