Question

CDC: How to configure multiple tables for CDC in a single pipeline in a single destination node/table?

  • 16 December 2022
  • 1 reply
  • 35 views

How to configure multiple tables (rather configuring each field/attribute) for CDC in a single pipeline to a single destination node/table?

Ex: I have 5 tables which are different in terms of no of columns, column datatypes, field data size etc.
If I need to build CDC for all the 5 tables which gives table specific data without mapping/configuring field by field in a single pipeline in a single destination node (that is table).
 


1 reply

Userlevel 5
Badge +1

@hari_koramutla 

May i know if you have tried with jdbc multi consumer as origin where you can configure multiple tables and retrieve data from them.

If you are sending data to a single destination then you can add a lookup before the destination and do join on those tables and send data to destination.

please let me know if you have any questions/concerns.

Reply