Hello!!
Currently, I’m using the SDK to extract metrics from some jobs. However, instead of having only {run_count, input_count, output_count, total_error_count} from sch.job.metrics
, I would like to have some other metrics as well, such as counting each record for each step of my job. Is this possible? How can I achieve this?
I’m also looking to get the last received record (for each pipeline) that we can see in the real-time summary. How can I get this metric from ControlHub using the SDK?