Skip to main content

I am on Data Collector 3.21.x.

 

I noticed that the “PipelineStateHistory.json” file keeps growing in size. Are there are workarounds or suggestions to just keep the last few days or last few runs history in-order to limit the file size growth?

@Srinivasan Sankar Already a feature request is opened for this issue. 

Workaround:

  • You can use the clear history (regularly) to avoid growing the file size. 

OR

  • This step is little tricky but you can try and see:
    • Manually you can try removing the unnecessary Run History (i.e., by modifying the pipelineStateHistory.json). 
    • I don’t suggest this method because if you make any mistake the file may corrupt and effect the pipeline.

FYI: Generally this pipelineStatehistory.json wont be a problem if you are using control-hub.

Thanks!

Thanks @Ranjith P, happy to know that a feature request is already opened. 

Yes until we have the feature developed, manually clearing the history is our ONLY option.

Reply


Terms & Conditions