Skip to main content
Solved

Error : Java heap Space


realmatcha
Opening Band

I have 98 columns/fields and 250,000 rows, every time I run it always error, what i'm doing now is to reduce the :
Max Batch Size (Records) = 10
Max Clob Size (Characters) = 10
Max Blob Size (Bytes) = 10
Fetch Size = 10
because the default is 1000 and an error will occur. How to handle that problem?

Best answer by Pradeep

@realmatcha You can either reduce the batch size which you are currently working around with or increase the heap memory given to the related streamsets engine.

View original
Did this topic help you find an answer to your question?

2 replies

Pradeep
StreamSets Employee
Forum|alt.badge.img+1
  • StreamSets Employee
  • 48 replies
  • Answer
  • May 30, 2023

@realmatcha You can either reduce the batch size which you are currently working around with or increase the heap memory given to the related streamsets engine.


realmatcha
Opening Band
  • Author
  • Opening Band
  • 13 replies
  • June 2, 2023

@Pradeep I have up the memory from 1024mb to 8192mb and it works very well, thank you


Reply