Skip to main content
Question

Load data from Teradata to Snowflake

  • 23 January 2024
  • 1 reply
  • 35 views

hrishikeh132609
Fan

I am trying to load data from Teradata to Snowflake. I am using Transformer for spark as engine.

Origin:

 JDBC query consumer. 

Destination:

Snowflake

I am able to load 12 million data in 1 hour.

 but I want to improve the performance.

Below is the configuration of my pipeline.

 

 

 

1 reply

Bikram
Headliner
Forum|alt.badge.img+1
  • Headliner
  • 486 replies
  • January 27, 2024

@hrishikeh132609 

can you please try to enable the cache data and also try the option to enable the lubricrous mode as well.

Generally cache data enabling increase the performance .


Reply