Skip to main content

Hi team,

how to join datasets using kafka and how to join them?

Please help me this one. 

@vasanthi Could you please elaborate your usecase with more details. What do you mean by join dataset using kafka? 

I have a requirement in which I have to join two files using kafka

You can use Directory origin to read files and then use Kafka Producer as destination to write this file.

i have take two files in directory origin?

 

The Directory origin reads data from files in a directory. You can put these two files in a directory and then configure origin to read this. 

ref : https://docs.streamsets.com/portal/platform-datacollector/latest/datacollector/UserGuide/Origins/Directory.html#concept_qcq_54n_jq

Reply


Terms & Conditions