Question

Store Procedure in JDBC Query consumer - incomplete data

  • 4 November 2022
  • 1 reply
  • 53 views
URIBPA
Rank

Hi all. 
I have a stored procedure (quite lengthy that creates a temporary table and then deletes it) that I have managed to get to run in JDBC Query Consumer (in full mode). This procedure performs the query to SQL Server and on average it takes about 9 minutes to get the result of the execution from a database manager. The issue is that when I perform a "Preview" it does not bring me the same data and what it brings, it brings it incomplete. Do you know what could be affecting the result? 
I used the query directly and the query improved a little but not completely.
I also tried in "Test Run" but it does not give me the result of the query.
What could it be? 

 

1 reply

saleempothiwala
Rank
Userlevel 4
Badge

Hi @URIBPA 

Preview, as the names suggests is to get a preview of the data before you run the pipeline. By default it has an property that limits it to 10 records. Test run would be the best way to see the data. Use a Local FS or S3 destination to load the data and see the results if you want to verify. Once you are happy, use the desired destination.

Reply


Terms & Conditions