Question:
- How to configure SDC to connect more than one Hadoop clusters?
Answer:
Configure two different Hadoop client configurations
Ex: 1) /etc/hadoop-A/conf 2) /etc/hadoop-B/conf
In SDC, HadoopFS Dest to interact with hadoop-A use below config:
File System URI: hdfs://hadoop-A:8020/
Configuration Files Directory: /etc/hadoop-A/conf/
HadoopFS Dest to interact with hadoop-dev use below config:
File System URI: hdfs://hadoop-B:8020/
Configuration Files Directory: /etc/hadoop-B/conf/
