i am reading a file from S3 bucket and doing lookup against data from Postgress DB using JDBC lookup using Data collector.
in source i have some 341k records against 341 records in postgress DB.
my observations are
1.it taking 30min to process 50K records.
2.some records are going to error even matching one present in DB
3.i have tried by enabling local cache.