I am trying to load data from Teradata to Snowflake. I am using Transformer for spark as engine.
Origin:
JDBC query consumer.
Destination:
Snowflake
I am able to load 12 million data in 1 hour.
but I want to improve the performance.
Below is the configuration of my pipeline.
![](https://uploads-us-west-2.insided.com/streamsets-en/attachment/f2b91e16-7e7e-45b0-a2a6-76bc08978320.png)
![](https://uploads-us-west-2.insided.com/streamsets-en/attachment/e558f30e-6151-4f03-ae18-aac14b2143dc.png)
![](https://uploads-us-west-2.insided.com/streamsets-en/attachment/0a5b1629-4ce6-42f6-b5f2-b9000bf5d6e8.png)
![](https://uploads-us-west-2.insided.com/streamsets-en/attachment/56367d78-a5e4-46de-8a05-c09edc3a3685.png)
![](https://uploads-us-west-2.insided.com/streamsets-en/attachment/4f02d251-13eb-4b65-ab03-18005740856b.png)