Hi,
I’m trying to fetch data from Shopify using HTTP Clent Origin with pagination set to “Link in HTTP Header”.
As per Shopify (refer link here - https://shopify.dev/api/usage/pagination-rest#link-headers) - the parameters that comes back in “link” contain the page_info parameter that we should be using while querying the next page.
Using StreamSets HTTP Client Origin, the pagination option using “Link in HTTP Header” is not working. I think this is because SDC is expecting the parameter name as “page” and hence this issue.
Has anybody faced this earlier and if so how have you been able to make progress here?
Anyone from StreamSets who can comment on this?