Skip to main content

I am trying to load data from Teradata to Snowflake. I am using Transformer for spark as engine.

Origin:

 JDBC query consumer. 

Destination:

Snowflake

I am able to load 12 million data in 1 hour.

 but I want to improve the performance.

Below is the configuration of my pipeline.

 

 

 

@hrishikeh132609 

can you please try to enable the cache data and also try the option to enable the lubricrous mode as well.

Generally cache data enabling increase the performance .


Reply