Is it feasible to set up the transformer pipeline so that it runs on an AWS EMR cluster?

I built a primary transformer pipeline that will operate on an EMR cluster. I utilized the essential setup details in Cluster configuration.
I'm having the following problem:
for a Transformer Engine

2 replies

Userlevel 5
Badge +1


Yes , the transformer pipeline can be configured on EMR cluster and if you can provide me the error details i can check on it.

Userlevel 4



make sure your transformer url is reachable from AWS EMR. 

If you are using a docker for transformer engine then you will have to make configuration such that the docker is accessible from the internet.