Solved

START_JOBS orgin throws error - DataOps Platform


Userlevel 3
Badge +1

Hi there,

  1. I have a simple pipeline that uses “Data Generator” as the source and writes to Trash.
  2. I published this pipeline and I have created a job instance. 
  3. I then created an orchestration pipeline with “Start_Jobs” origin as the source and I call the job instance created in the previous step. There are no parameters required for the job as it is a simple job (data generator to trash).
  4. I use API based authentication and I have provided the API cred. ID and Token.
  5. I use the following URL, https://cloud.login.streamsets.com for my Origin stage.

 

I get the following error message when I try to test run my orchestration pipeline, 

 

com.streamsets.pipeline.api.StageException: START_JOB_03 - Failed to start job for job ID: 287e3a1a-c08b-4a1e-916d-2c2d9cc2068c:XXXXXXXXXXXXXXXXXX, status code '405': <html>
<head><title>405 Not Allowed</title></head>
<body>
<center><h1>405 Not Allowed</h1></center>
<hr><center>nginx</center>
</body>
</html>

 

From the log, I see the following error message,

 

com.streamsets.pipeline.api.StageException: START_JOB_03 - Failed to start job for job ID: 287e3a1a-c08b-4a1e-916d-2c2d9cc2068c:XXXXXXXXXXXXXXXX, status code '405': <html>
<head><title>405 Not Allowed</title></head>
<body>
<center><h1>405 Not Allowed</h1></center>
<hr><center>nginx</center>
</body>
</html>


    at com.streamsets.pipeline.lib.startJob.StartJobSupplier.startJob(StartJobSupplier.java:179) ~[streamsets-datacollector-orchestrator-lib-5.0.0.jar:?]
    at com.streamsets.pipeline.lib.startJob.StartJobSupplier.get(StartJobSupplier.java:68) ~[streamsets-datacollector-orchestrator-lib-5.0.0.jar:?]
    at com.streamsets.pipeline.lib.startJob.StartJobSupplier.get(StartJobSupplier.java:31) ~[streamsets-datacollector-orchestrator-lib-5.0.0.jar:?]
    at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_332]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_332]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_332]
    at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_332]

 

FYI - I am an org. admin on the DataOps Platform.

 

Any suggestions?

 

Thanks,

Srini

icon

Best answer by Giuseppe Mura 6 May 2022, 21:16

View original

3 replies

Userlevel 4
Badge

@Srinivasan Sankar  You need to provide correct Control Hub URL( DataOps URL) . this url  https://cloud.login.streamsets.com  doesn’t seems to be right. I am able to reproduce the exact error when I pass wrong control hub url.

Userlevel 3
Badge

@Srinivasan Sankar , your URL should be something like https://ap01.hub.streamsets.com (if you’re on the Australian hub), check the URL once you login via the UI for the correct address.

Userlevel 3
Badge +1

Thanks @Rishi , @Giuseppe Mura .

When I updated the URL to https://ap01.hub.streamsets.com, my orchestration pipeline ran successfully.

 

For others, if you are unsure what the Control Hub URL for your DataOps platform is, please refer “Outbound Connections” section in the following page,

 

https://docs.streamsets.com/portal/platform-controlhub/controlhub/UserGuide/Deployments/Firewall.html?hl=firewall

 

Reply