Skip to main content
Solved

START_JOBS orgin throws error - DataOps Platform


Forum|alt.badge.img+1

Hi there,

  1. I have a simple pipeline that uses “Data Generator” as the source and writes to Trash.
  2. I published this pipeline and I have created a job instance. 
  3. I then created an orchestration pipeline with “Start_Jobs” origin as the source and I call the job instance created in the previous step. There are no parameters required for the job as it is a simple job (data generator to trash).
  4. I use API based authentication and I have provided the API cred. ID and Token.
  5. I use the following URL, https://cloud.login.streamsets.com for my Origin stage.

 

I get the following error message when I try to test run my orchestration pipeline, 

 

com.streamsets.pipeline.api.StageException: START_JOB_03 - Failed to start job for job ID: 287e3a1a-c08b-4a1e-916d-2c2d9cc2068c:XXXXXXXXXXXXXXXXXX, status code '405': <html>
<head><title>405 Not Allowed</title></head>
<body>
<center><h1>405 Not Allowed</h1></center>
<hr><center>nginx</center>
</body>
</html>

 

From the log, I see the following error message,

 

com.streamsets.pipeline.api.StageException: START_JOB_03 - Failed to start job for job ID: 287e3a1a-c08b-4a1e-916d-2c2d9cc2068c:XXXXXXXXXXXXXXXX, status code '405': <html>
<head><title>405 Not Allowed</title></head>
<body>
<center><h1>405 Not Allowed</h1></center>
<hr><center>nginx</center>
</body>
</html>


    at com.streamsets.pipeline.lib.startJob.StartJobSupplier.startJob(StartJobSupplier.java:179) ~[streamsets-datacollector-orchestrator-lib-5.0.0.jar:?]
    at com.streamsets.pipeline.lib.startJob.StartJobSupplier.get(StartJobSupplier.java:68) ~[streamsets-datacollector-orchestrator-lib-5.0.0.jar:?]
    at com.streamsets.pipeline.lib.startJob.StartJobSupplier.get(StartJobSupplier.java:31) ~[streamsets-datacollector-orchestrator-lib-5.0.0.jar:?]
    at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_332]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_332]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_332]
    at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_332]

 

FYI - I am an org. admin on the DataOps Platform.

 

Any suggestions?

 

Thanks,

Srini

Best answer by Giuseppe Mura

@Srinivasan Sankar , your URL should be something like https://ap01.hub.streamsets.com (if you’re on the Australian hub), check the URL once you login via the UI for the correct address.

View original
Did this topic help you find an answer to your question?

3 replies

Rishi
StreamSets Employee
Forum|alt.badge.img
  • StreamSets Employee
  • 96 replies
  • May 6, 2022

@Srinivasan Sankar  You need to provide correct Control Hub URL( DataOps URL) . this url  https://cloud.login.streamsets.com  doesn’t seems to be right. I am able to reproduce the exact error when I pass wrong control hub url.


Giuseppe Mura
StreamSets Employee
Forum|alt.badge.img
  • StreamSets Employee
  • 37 replies
  • Answer
  • May 6, 2022

@Srinivasan Sankar , your URL should be something like https://ap01.hub.streamsets.com (if you’re on the Australian hub), check the URL once you login via the UI for the correct address.


Forum|alt.badge.img+1

Thanks @Rishi , @Giuseppe Mura .

When I updated the URL to https://ap01.hub.streamsets.com, my orchestration pipeline ran successfully.

 

For others, if you are unsure what the Control Hub URL for your DataOps platform is, please refer “Outbound Connections” section in the following page,

 

https://docs.streamsets.com/portal/platform-controlhub/controlhub/UserGuide/Deployments/Firewall.html?hl=firewall

 


Reply