Skip to main content
Solved

How to use mover tool to migrate data from one on-prem dc to another on-prem dc


I have used mover tool commands to migrate data like pipelines, jobs, users etc from one older version SCH (say 3.X) to a new one (say DataOps).

Below are the commands used for migration:

 

a) export SCH_USER_ID=<user_id>

b) export SCH_PASSWORD=<password>

c) export WORK_DIR=<Local system file path>

d) export SCH_URL=<url> set URL of the SCH e) export STREAMSETS_SDK_ACTIVATION_KEY='activation key' 

sudo docker run -e "STREAMSETS_SDK_ACTIVATION_KEY=${STREAMSETS_SDK_ACTIVATION_KEY}" -it -v ${WORK_DIR}:/out streamsets/mover_tool -v export --sch-server-url ${SCH_URL} --sch-user-id "${SCH_USER_ID}" --sch-password "${SCH_PASSWORD}"

 

Now I want to do the same migration from one on-prem sdc to another sdc.

Is this possible? If yes can someone help me in this.

 

Best answer by Sanjeev

@saikat_chatterjee yes, it can be easily done via the Python SDK 

 

View original
Did this topic help you find an answer to your question?

5 replies

Sanjeev
StreamSets Employee
Forum|alt.badge.img
  • StreamSets Employee
  • 53 replies
  • July 11, 2023

@saikat_chatterjee The mover tool is designed to move from the legacy 3.x ControlHub to newer StreamSets Platform. It’s not designed to move assets between engines.  


@Sanjeev Thank you for your response.

I understand that, but is there a way to move the pipelines between engines in a bulk.


Sanjeev
StreamSets Employee
Forum|alt.badge.img
  • StreamSets Employee
  • 53 replies
  • Answer
  • July 11, 2023

@saikat_chatterjee yes, it can be easily done via the Python SDK 

 


@Sanjeev I was able to do the migration using Python SDK.

Thank you!


Sanjeev
StreamSets Employee
Forum|alt.badge.img
  • StreamSets Employee
  • 53 replies
  • July 17, 2023

That’s great @saikat_chatterjee Glad to see that you found the SDK helpful. 


Reply