You can write the extraction statement with a where cluase (where load_date > Start_date and load_date < end_date soething like this) in a SQL stage. Here, you will have to assign the variale values before the extraction process.
But Make sure the start_date and End_date you pass is such way that, you won't miss any records
In one of my previous projects we had a simialr req. We incorporated the Extraction_start_time and Extractio_End_Time columns in batch control table. And the Batch staart process(script/DF) will calcuate the Extraction_start_time and Extraction_end_timetime. Obviously Extraction_start_time will be the Extraction_end_time of last batch.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.