Skip to main content
Solved

S3 Destination WARN "No content length specified..."

  • October 26, 2021
  • 1 reply
  • 1406 views

Dash
Headliner
Forum|alt.badge.img+3
  • Senior Technical Evangelist and Developer Advocate at Snowflake
  • 67 replies

When writing to Amazon S3 destination why are these “WARN” messages showing up in the logs? Does this have any impact on the running pipeline?

 

No content length specified for stream data. Stream contents will be buffered in memory and could result in out of memory errors.

 

Best answer by Dash

These messages are coming directly from the AWS client library code. Basically when streaming data to/from S3, they don't send a content-length header along with the payload; since it’s streaming mode.

Note that these are just warnings and not errors so this should not impact the running pipeline.

 

 

View original
Did this topic help you find an answer to your question?

1 reply

Dash
Headliner
Forum|alt.badge.img+3
  • Author
  • Senior Technical Evangelist and Developer Advocate at Snowflake
  • 67 replies
  • Answer
  • October 26, 2021

These messages are coming directly from the AWS client library code. Basically when streaming data to/from S3, they don't send a content-length header along with the payload; since it’s streaming mode.

Note that these are just warnings and not errors so this should not impact the running pipeline.

 

 


Reply