Scala Spark Job "createOrReplaceTempView" error in Transformer job

Hi,

We have a Scala spark Job where we read couple of CSV files into data frames and create temporary views ("createOrReplaceTempView") on those data frames. Then we write business rules logic in Spark SQL using the tempororary views created earlier and write the result into another dataframe.

We tried to incoroporate this Scala Spark Job in Transformer using Scala Stage. But we are facing an error while creating “createOrReplaceTempView”. Could you please help resolve the issue and let us know how we can incorporate Scala Spark Job in Streamsets Transformer?

Thanks,

Pradeep