Question

How does the JDBC Lookup Cache work?

  • 2 August 2022
  • 1 reply
  • 18 views

Userlevel 1

The JDBC Lookup documentation explains how to configure the cache and how the eviction works, but there is no discussion about how the cache actually works. Is the query being evaluated and then hashed, with the hash value being used as a key? or is something else happening?


1 reply

Userlevel 2
Badge

Cache if “resolved query”-based. Given the lookup SQL Query, and once resolved all potential existing EL expressions in it, the cache will store an entry with key this resolved query, and with value the result of this query.

Please check documentation for other generic details: https://docs.streamsets.com/portal/platform-datacollector/latest/datacollector/UserGuide/Processors/JDBCLookup.html#concept_vsl_dvt_d2b.

 

Reply