We are using streamsets to load data to snowflake table. We configured an common Internal Stage for the pipeline, as well as target tables, can we understand the mechanism for such pipelines are firstly load data as file and put into Snowflake cloud (Internal Stage), and then will trigger a copy command from Internal Stage to taget Snowflake tables like:
copy into mytable … (is it from user stage or table stage or name stage)?
Can StreamSets load data to external stage and then copy to table?
ANy cost difference for load data to external stage and internal stage by StreamSets?
I suppose it is just the cost difference between the storage cost of snowflake cloud and external cloud, cause external cloud a bit cheaper than snowflake internal cloud? Any computing resource difference when loading to internal and external stages.