Question:
Is it possible to process file by file within or across clusters (such distcp
command can do) with the Hadoop FS stage?
Answer:
If you need to move the whole files, you could try using our Hadoop FS Standalone origin (introduced in the SDC version 3.2.0.0), which supports Whole FIle format. You can find more information about the origin in our documentation.