Hi,
Understand GCS stage in SDC does not support Parquet but is there any reason or workaround to read Parquet from GCS using Data Collector?
Thank you.
Hi,
Understand GCS stage in SDC does not support Parquet but is there any reason or workaround to read Parquet from GCS using Data Collector?
Thank you.
Parquet is a column oriented data storage format where as SDC is row-based micro batching processing engine hence it cannot read parquet.
You can use StreamSets Transformer engine to read parquet files and transform it.
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.