Issue:-

While scheduler trying to start the job on scheduled time it failed with following error:-

ERROR InfluxDBTimeSeriesBackend - Error writing metrics to sub systems: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@ef0b00f rejected from java.util.concurrent.ThreadPoolExecutor@282e5632[Running, pool size = 4, active threads = 4, queued tasks = 10000, completed tasks = 12368917]

Resolution:-

Influx DB is not processing the requests efficiently as the queued tasks reached it limit to 10000. There can be two approaches to address the issue:-

1. Increase the task limit using following property in the timeseries-app.properties. 

   metrics.callable.queue.size=20000

      2. Get in touch with InfluxDB support to optimise the performance.