If you want to change the minimum log level for DC logs, you need to edit in sdc-log4j.properties these values:

• log4j.logger.com.streamsets.pipeline
• log4j.logger.com.streamsets.datacollector

After the change you don't need to restart the SDC.

LOG LEVELS:

• TRACE
• DEBUG
• INFO (Default)
• WARN
• ERROR
• FATAL

Default:

log4j.logger.com.streamsets.pipeline=INFO

log4j.logger.com.streamsets.datacollector=INFO 

Example with DEBUG Log Level:

log4j.logger.com.streamsets.pipeline=DEBUG

log4j.logger.com.streamsets.datacollector=DEBUG

If you are using Cloudera Manager, you can change the log level here:

CM UI: Clusters -> StreamSets -> Configuration -> Category -> Logs

Attached screenshots:

• SDC_Logging_Threshold.png (60 KB)
• CM_DC_Logging_Threshold.png (100 KB)

@aneta 

November 21, 2016 13:45