How easy would it be to create a custom Scala or PySpark stage, that can output an array of spark data frames (like it can receive for input) rather than just one?
Thanks for the response!
Could you possibly share an example? as i’m a little unsure on what you mean exactly.
Thanks
Reply
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.