Skip to main content

Difference in  data rule vs data drift rule with some scenario, use case?

@lakshmi_narayanan_t 

 

Data Rules :Gathers details about data as it passes between two stages. 

 

E.g : ${record:value(‘/Manger’) == NULL or ${record:value(‘/average_age’) < 10

 

Alert name (Employees having manager field null or Employees are below age limit) .

 

Data Drift : 

It determines changes in the data size,number ,count etc.

 

e,g if column name changes in DB table or number of column reduced , then data drift will generate error.

CASE 1:

  • Label: field name change

  • Condition: ${drift:names('/',false)}

  • Sampling Percentage: 100

  • Check  the Enable Meter option

Alert Text: there is a field name change(s) in the related source

 

CASE 2 :

  • Label: drift size

  • Condition: ${ drift:size('/',false)}

  • Sampling Percentage: 100

  • Check  the Enable Meter option

Alert Text: ${ alert:info()}


Reply