Delta load performance

[Former Member]

Hi All,

I am using delta load and full load with the conditional.

Fact table data flow is like this:

DF1: Oracle --> Staging

DF2: Staging--> DWH

I am passing Dimension table value by using lookup_ext tranform at Staging--> DWH

No of rows in Dimension table is 200

no of rows in Fact table is 125,000.

Full load is taking 3 mins where as delta load is taking 30 mins.

Please check below sample job screens.

Kindly advise to improve the performance.

Thanks in advance.

BODS Version is XI3.1

[abhi2636]

Hi Kiwi,

Your delta load might be slow because of 'Row by row select' comparison method used in table comparison.

Could you please try with 'Cached comparison' or 'Sorted input' comparison methods.

If you are planning to go with Sorted input (better go with this method), please sort the data before sending to Table comparison transform.

And also check out with 'Cache type' used in Lookup_ext function.

Thanks,

Abhi