Question

Load data from Teradata to Snowflake

  • 23 January 2024
  • 1 reply
  • 24 views

I am trying to load data from Teradata to Snowflake. I am using Transformer for spark as engine.

Origin:

 JDBC query consumer. 

Destination:

Snowflake

I am able to load 12 million data in 1 hour.

 but I want to improve the performance.

Below is the configuration of my pipeline.

 

 

 


1 reply

Userlevel 5
Badge +1

@hrishikeh132609 

can you please try to enable the cache data and also try the option to enable the lubricrous mode as well.

Generally cache data enabling increase the performance .

Reply