Skip to main content

i have declared s3 data format as below but in UI/Control hub data format is showing blank.

pipeline_builder = sch.get_pipeline_builder(engine_type='data_collector', engine_url=”XXXX”)

s3_origin = pipeline_builder.add_stage('Amazon S3', type='origin')

-

-

s3_origin.data_format ='Text'.

How to see values allowed for any particular component in SDK.(ex s3_origin.data_format ,s3_origin.delimiter etc..)

i have declared s3 data format as below but in UI/Control hub data format is showing blank.

pipeline_builder = sch.get_pipeline_builder(engine_type='data_collector', engine_url=”XXXX”)

s3_origin = pipeline_builder.add_stage('Amazon S3', type='origin')

-

-

s3_origin.data_format ='Text'.

How to see values allowed for any particular component in SDK.(ex s3_origin.data_format ,s3_origin.delimiter etc..)

 

Could you share the complete code so that we can be sure you arent missing the obvious

i have declared s3 data format as below but in UI/Control hub data format is showing blank.

pipeline_builder = sch.get_pipeline_builder(engine_type='data_collector', engine_url=”XXXX”)

s3_origin = pipeline_builder.add_stage('Amazon S3', type='origin')

-

-

s3_origin.data_format ='Text'.

How to see values allowed for any particular component in SDK.(ex s3_origin.data_format ,s3_origin.delimiter etc..)

Change s3_origin.data_format ='Text' → s3_origin.data_format ='TEXT'

 

how to know what values are there in s3_origin.data_format or do we have any documenation

Reply


Terms & Conditions