Skip to main content

I am trying to call a SOAP API which requires page number and number of records to be mentioned in request body.

We have multiple pages in response however streamsets pipeline just ingest the first page.

 

resource URL - just URL of the API call , no variable for pagination here .

Headers : blank

mode : batch

HTTP Method : POST

Request body : complete request body with page number 

 

<Response Filter>

   <Page>1<Page>
   <Count>999<Count>
</Response Filter>
 

Pagination:

 

By page number 

initial page :1 

rest default 

 

can someone help how to retrieve all available pages.

tried using value ${startAt} for page in request body.

 

 

Was this a 2 step authentication?


By the way i think you should be using a get request not a post.


Reply