I am trying to call a SOAP API which requires page number and number of records to be mentioned in request body.
We have multiple pages in response however streamsets pipeline just ingest the first page.
resource URL - just URL of the API call , no variable for pagination here .
Headers : blank
mode : batch
HTTP Method : POST
Request body : complete request body with page number
<Response Filter>
<Page>1<Page>
<Count>999<Count>
</Response Filter>
Pagination:
By page number
initial page :1
rest default
can someone help how to retrieve all available pages.
tried using value ${startAt} for page in request body.