Skip to main content
Solved

Compare records from 2 sources in Jython Evaluator

  • December 10, 2021
  • 2 replies
  • 151 views

I am trying to use Jython Evaluator for fuzzy matching. I need to compare a record from one source with another in Jython code and emit only 1 record from evaluator.

So my question is how do i access records (values) from 2 different sources at the same in Jython evaluator?

Request for assistance

Best answer by Giuseppe Mura

@akkisabby Data Collector pipelines are single origin so you won’t be able to merge/join records from multiple origins the way you are asking.

Please check out Transformer, which indeed provides the ability to join (heterogeneous) sources through the Joiner processor.

2 replies

  • Author
  • Fan
  • December 15, 2021

Hi Team, Can any one please comment on this


Giuseppe Mura
StreamSets Employee
Forum|alt.badge.img
  • StreamSets Employee
  • Answer
  • December 15, 2021

@akkisabby Data Collector pipelines are single origin so you won’t be able to merge/join records from multiple origins the way you are asking.

Please check out Transformer, which indeed provides the ability to join (heterogeneous) sources through the Joiner processor.