RUN_ERROR: FILE_OPERATOR_ERROR_09 - Directory path does not exist : Transformer

Product: StreamSets Transformer | Spark On Hadoop Yarn

Issue:

When read from a local file system, use the following format:

file:///<directory>

Pipeline fails with below error

 RUN_ERROR: FILE_OPERATOR_ERROR_09 - Directory path does not exist 

Solution:

You need to make sure the folder is available in all yarn nodes if you are using a cluster manager type “Hadoop YARN.”