Question

Is it feasible to set up the transformer pipeline so that it runs on an AWS EMR cluster?

  • 5 May 2023
  • 2 replies
  • 24 views

I built a primary transformer pipeline that will operate on an EMR cluster. I utilized the essential setup details in Cluster configuration.
I'm having the following problem:
Pipeline
for a Transformer Engine
Transformer
 


2 replies

Userlevel 4
Badge

@Chromeheartshoodie42 

 

make sure your transformer url is reachable from AWS EMR. 

If you are using a docker for transformer engine then you will have to make configuration such that the docker is accessible from the internet.

Userlevel 5
Badge +1

@Chromeheartshoodie42 

Yes , the transformer pipeline can be configured on EMR cluster and if you can provide me the error details i can check on it.

Reply