Skip to main content
Solved

How to convert AVRO file to Parquet in Steam sets?

  • September 23, 2021
  • 3 replies
  • 255 views
K
Fan

Hi Folks...Can anyone Please provide detailed steps/Info for the conversion of AVRO to Parquet?

Best answer by Marty Norris

Hi @kasieswar4204.  If you are using StreamSets Transformer engine, Parquet is a built-in data type.  If you are using the StreamSets Data Collector engine, here is a link to converting data to Parquet:

https://docs.streamsets.com/portal/#platform-datacollector/latest/datacollector/UserGuide/Solutions/Parquet.html

View original
Did this topic help you find an answer to your question?

3 replies

Marty Norris
StreamSets Employee
  • Marty NorrisStreamSets Employee
  • StreamSets Employee
  • 4 replies
  • Answer
  • September 23, 2021

Hi @kasieswar4204.  If you are using StreamSets Transformer engine, Parquet is a built-in data type.  If you are using the StreamSets Data Collector engine, here is a link to converting data to Parquet:

https://docs.streamsets.com/portal/#platform-datacollector/latest/datacollector/UserGuide/Solutions/Parquet.html

Dash
1 person likes this
  • Dash
    Dash
K
Fan

Thank you!!! @Marty Norris. I Just go it now.

How to read the AVRO file in streams Sets? Can you suggest any steps ?

 

Thanks in Advance !!

 

Sanjeev
StreamSets Employee
Forum|alt.badge.img
  • SanjeevStreamSets Employee
  • StreamSets Employee
  • 53 replies
  • September 25, 2021

@kasieswar4204 please refer to this doc

Reply


Terms & Conditions