Question

Build a Transformer pipeline: org.apache.spark.sql.AnalysisException: Partition column `` not found in schema

  • 14 December 2022
  • 0 replies
  • 76 views

Hi Team,

While building a Transformer pipeline exercise, I was joining (Inner Join) two MySQL Tables from classicmodels database, employees & customers tables using condition “employees_employeeNumber = customers_salesRepEmployeeNumber”

its showing below error: 
org.apache.spark.sql.AnalysisException: Partition column `` not found in schema struct<employees_lastName:string,employees_firstName:string,employees_email:string,employees_employeeNumber:int,employees_officeCode:string,customers_customerNumber:int,customers_salesRepEmployeeNumber:int,customers_creditLimit:decimal(10,2)>;


0 replies

Be the first to reply!

Reply