Solved

Pipeline State History JSON file

  • 13 December 2021
  • 2 replies
  • 141 views

Userlevel 3
Badge +1

I am on Data Collector 3.21.x.

 

I noticed that the “PipelineStateHistory.json” file keeps growing in size. Are there are workarounds or suggestions to just keep the last few days or last few runs history in-order to limit the file size growth?

icon

Best answer by Ranjith P 13 December 2021, 10:19

View original

2 replies

Userlevel 2
Badge

@Srinivasan Sankar Already a feature request is opened for this issue. 

Workaround:

  • You can use the clear history (regularly) to avoid growing the file size. 

OR

  • This step is little tricky but you can try and see:
    • Manually you can try removing the unnecessary Run History (i.e., by modifying the pipelineStateHistory.json). 
    • I don’t suggest this method because if you make any mistake the file may corrupt and effect the pipeline.

FYI: Generally this pipelineStatehistory.json wont be a problem if you are using control-hub.

Thanks!

Userlevel 3
Badge +1

Thanks @Ranjith P, happy to know that a feature request is already opened. 

Yes until we have the feature developed, manually clearing the history is our ONLY option.

Reply