Cloud DB migration - query

  • 19 October 2023
  • 1 reply
  • 7 views
S
Rank

Can we configure multiple tables in same pipeline when we use JDBC Query consumer 1 as origin and JDBC producer 1 as destination. in my case i need to send 20 tables data to send from on-premise DB (db2) to cloud DB (Azure postgresql)?. i am thinking to avoid multiple pipelines creation in streamsets.

1 reply

Pradeep
Rank
Userlevel 3
Badge +1

@Sankar Arunachalam You can use MultiTableJDBCConsumer to configure multiple tables in a single stage in one pipeline. jdbc.tables is a record header attribute which might come in handy if you want to pass record to a particular table in destination from source. Read through SDC documents https://docs.streamsets.com/portal/datacollector/latest/help/index.html for the same.

Reply


Terms & Conditions