After going through the configuration for Data bricks Delta lake destination ,I’m trying to partitioning table based on partition column but encountered with an "DELTA_LAKE_41" error message.
Solved
DELTA_LAKE_41 - Destination Table not found in partition columns
- Roadie
- 7 replies
Best answer by alex.sanchez
Exactly, we added support for Databricks 7.x and 8.x clusters on that version, so partition columns are not supported before 1.4
Ravisaga!
1 person likes this
- StreamSets Employee
- 73 replies
Hi!
If I’m not mistaken that should be solved in a newer version of the Databricks Enterprise Library.
Which version are you using?
Thanks
Alex - StreamSets Engineering Manager @ Collector
1 person likes this
- StreamSets Employee
- 73 replies
That is only supported in our databricks library from version 1.4 
- Roadie
- 7 replies
Can you please elaborate Alex ,that means Partition Column is supported from databricks Library version 1.4 in Streamsets.
- StreamSets Employee
- 73 replies
- Answer
Exactly, we added support for Databricks 7.x and 8.x clusters on that version, so partition columns are not supported before 1.4
Alex - StreamSets Engineering Manager @ Collector
Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.