Skip to main content

Can we read from parquet file format?

  • November 19, 2021
  • 0 replies
  • 346 views

Sami
StreamSets Employee
  • StreamSets Employee

 

Parquet is columnar storage format. 

 

Data Collector is a row-based stream-processing engine, hence we can not read from parquet file format.

 

More information can be found in SDC-4501.

 

To satisfy this use case, we can use StreamSets Transformer.  

Did this topic help you find an answer to your question?
This topic has been closed for comments