Question:
In the 'Hadoop FS' configuration tab in the Hadoop stages, there is a setting called 'Hadoop FS Configuration Directory' to specify a directory in $SDC_RESOURCES containing the Hadoop configuration files, as well as settings for individual Hadoop FS configuration properties ('Hadoop FS URI' and list under 'Hadoop FS Configuration'). When both are used, what properties are loaded?
Answer:
If a Hadoop configuration directory path is specified in the 'Hadoop FS Configuration Directory' property, the discovered core-site.xml and hdfs-site.xml settings will be loaded. Afterwards, the additional properties specified under 'Hadoop FS Configuration' are loaded as overrides. Also, if the 'Hadoop FS URI' is specified, it will take precedence.