Skip to main content

External Runtime Resource File Does not work with Cloudera Manager.

  • February 17, 2022
  • 0 replies
  • 26 views

AkshayJadhav
StreamSets Employee
Forum|alt.badge.img

In a Cloudera Managed SDC setup, using an external runtime properties file results in the following exception:

2016-07-20 15:41:43,628 WARN com.streamsets.datacollector.task.AbstractTask: Task 'stageLibrary' failed to initialize, java.lang.RuntimeException: Could not load runtime conf

iguration, 'java.io.FileNotFoundException: /run/cloudera-scm-agent/process/2124-streamsets-DATACOLLECTOR/test.properties (No such file or directory)', calling stopTask() and going into ERROR

java.lang.RuntimeException: Could not load runtime configuration, 'java.io.FileNotFoundException: /run/cloudera-scm-agent/process/2124-streamsets-DATACOLLECTOR/test.properties (No such file or directory)'

As of today with Cloudera Manager, runtime properties will only work in embedded mode:

runtime.conf.location=embedded

Edit the safety valve section in Cloudera Manager for sdc.properties to add your properties with the required prefix:

runtime.conf_<property name>=<value>

And then follow the rest of the documentation on how to call that runtime property: https://streamsets.com/documentation/datacollector/1.4.0.0/help/index.html#Advanced_Config/RuntimeProperties.html%23concept_fjx_g31_1s

 

 

This topic has been closed for replies.