Skip to main content

Process file by file within or across clusters.

  • February 19, 2022
  • 0 replies
  • 14 views

AkshayJadhav
StreamSets Employee
Forum|alt.badge.img

Question:

Is it possible to process file by file within or across clusters (such distcp command can do) with the Hadoop FS stage?

 

Answer:

If you need to move the whole files, you could try using our Hadoop FS Standalone origin (introduced in the SDC version 3.2.0.0), which supports Whole FIle format. You can find more information about the origin in our documentation.

Did this topic help you find an answer to your question?

0 replies

Be the first to reply!

Reply