Load data from Teradata to Snowflake

I am trying to load data from Teradata to Snowflake. I am using Transformer for spark as engine.

Origin:

JDBC query consumer.

Destination:

Snowflake

I am able to load 12 million data in 1 hour.

but I want to improve the performance.

Below is the configuration of my pipeline.

Page 1 / 1

@hrishikeh132609

can you please try to enable the cache data and also try the option to enable the lubricrous mode as well.

Generally cache data enabling increase the performance .

Sign up