Skip to main content

JDBC Producer Destination Writing to PostgresSQL throws JDBC_16.

  • January 27, 2022
  • 0 replies
  • 113 views

AkshayJadhav
StreamSets Employee
Forum|alt.badge.img

Product: Streamsets DataCollector

 

Issue:

Pipeline reads from oracle table and creates a table that does not exists in postgres using postgresSQL metadata stages and writes to postgres table using JDBC producer.
 

 

The error happens for all combinations of the Schemaname and tablename. I have tried cap case / small case etc nothing works.

Also if we remove the JDBC producer and redirect to Trash we do not see any error. Which indicates the error is coming from the JDBC producer.

What is strange is we do not have a PDB (Pluggable Database) concept in Postgres. 

 

Versions affected:

All versions 

 

Solution:

As per documentation

https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldRenamer.html

Add a  Field Renamer with the below expression to convert field names

Refer to the above screenshot.

Add the table name in Postgres metadata stage and JDBC producer stage as shown below.

I am also adding a sample pipeline to this KB that will work on any  "sdcVersion" : "3.13.0" and above.

 

Did this topic help you find an answer to your question?
This topic has been closed for comments