Question

while launching S3 from SDK giving error

  • 3 January 2022
  • 3 replies
  • 29 views
ashok verma
Rank

i have declared s3 data format as below but in UI/Control hub data format is showing blank.

pipeline_builder = sch.get_pipeline_builder(engine_type='data_collector', engine_url=”XXXX”)

s3_origin = pipeline_builder.add_stage('Amazon S3', type='origin')

-

-

s3_origin.data_format ='Text'.

How to see values allowed for any particular component in SDK.(ex s3_origin.data_format ,s3_origin.delimiter etc..)

3 replies

jerri
Rank

i have declared s3 data format as below but in UI/Control hub data format is showing blank.

pipeline_builder = sch.get_pipeline_builder(engine_type='data_collector', engine_url=”XXXX”)

s3_origin = pipeline_builder.add_stage('Amazon S3', type='origin')

-

-

s3_origin.data_format ='Text'.

How to see values allowed for any particular component in SDK.(ex s3_origin.data_format ,s3_origin.delimiter etc..)

 

Could you share the complete code so that we can be sure you arent missing the obvious

jerri
Rank

i have declared s3 data format as below but in UI/Control hub data format is showing blank.

pipeline_builder = sch.get_pipeline_builder(engine_type='data_collector', engine_url=”XXXX”)

s3_origin = pipeline_builder.add_stage('Amazon S3', type='origin')

-

-

s3_origin.data_format ='Text'.

How to see values allowed for any particular component in SDK.(ex s3_origin.data_format ,s3_origin.delimiter etc..)

Change s3_origin.data_format ='Text' → s3_origin.data_format ='TEXT'

 

ashok verma
Rank

how to know what values are there in s3_origin.data_format or do we have any documenation

Reply


Terms & Conditions