Skip to main content
Solved

Engine memory usage not being freed

  • July 5, 2022
  • 1 reply
  • 66 views

anthony.souza
Fan

 

After running a few draft runs, pausing and running it again, the memory reaches 80% and I can't run anymore and I have to restart the Engine.

How to make the memory free automatically since even with no more draft runs running the memory remains at 80%

Best answer by Rishi

@anthony.souza In java garbage collection is responsible for automatic memory management.

However, garbage collection is an asynchronous process and it kicks in under specific conditions when needed to provide more memory for object creation.  

Please check the below article for more details.
https://community.streamsets.com/best-practice-45/notes-about-garbage-collection-108

Also, I would suggest to Change per engine Max Memory to 100%

 

 

View original
Did this topic help you find an answer to your question?

1 reply

Rishi
StreamSets Employee
Forum|alt.badge.img
  • StreamSets Employee
  • 96 replies
  • Answer
  • July 5, 2022

@anthony.souza In java garbage collection is responsible for automatic memory management.

However, garbage collection is an asynchronous process and it kicks in under specific conditions when needed to provide more memory for object creation.  

Please check the below article for more details.
https://community.streamsets.com/best-practice-45/notes-about-garbage-collection-108

Also, I would suggest to Change per engine Max Memory to 100%

 

 


Reply