Product: Streamsets Data Collector running in Cloudera manager
Issue:
In cloudera manager the SDC_LOG parameter setting in Data Collector Advanced Configuration Snippet (Safety Valve) for sdc-env.sh is not taking effect. We are unable to redirect the sdc.log to a custom log location other that /var/log/sdc in cloudera manager based deployments
Versions affected:
All
Solution:
Workaround :
The fix for this was to add the below configuration changes in Cloudera manager.
CM -> Streamsets -> Configuration
-- TO REDIRECT gc.log
In Data Collector Advanced Configuration Snippet (Safety Valve) for sdc-env.sh
Add export SDC_LOG=/tmp
-- TO REDIRECT sdc.log
In Data Collector Logging Advanced Configuration Snippet (Safety Valve)
Add log.dir=/tmp
Add log4j.appender.streamsets.File=/tmp/sdc.logThis will ensure that the both sdc.log and gc.log are being written into /tmp
In long term this will be fixed as a part of https://issues.streamsets.com/browse/SDC-9717
