Issue:-
While scheduler trying to start the job on scheduled time it failed with following error:-
ERROR InfluxDBTimeSeriesBackend - Error writing metrics to sub systems: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@ef0b00f rejected from java.util.concurrent.ThreadPoolExecutor@282e5632[Running, pool size = 4, active threads = 4, queued tasks = 10000, completed tasks = 12368917]
Resolution:-
Influx DB is not processing the requests efficiently as the queued tasks reached it limit to 10000. There can be two approaches to address the issue:-
- Increase the task limit using following property in the timeseries-app.properties.
metrics.callable.queue.size=20000
2. Get in touch with InfluxDB support to optimise the performance.