I have created a pipeline with a parameter ‘date’ that will select data from hive for that particular date.
Is there a way, that if this wasnt populated, to select max(date) from the hive table?
The idea is that each time this is scheduled it will pick up latest data in the table, and if need be the parameter date will be set if a certain date needs to be rerun for whatever reason
Thanks in advance