How to improve DTP performance

[Former Member]

Hi Gurus,

Please find details of problem as follows:

Scenario: We are loading data (about 110000 records)from Datasource (PSA) to target Info object (Master Data Text). When this DTP is executed as part of process chain, takes two hours for completion. However if this DTP is executed manually or executed via 'Repair' option of process chain, load is completed in 20 - 30 minutes.

I have changed following settings for improving the DTP performance:

1) Reduced the package Size fo DTP from 50,000 to 10,000

2) Changes following Settings in

3) Increased parallel processing processes for DTP form 3 to 5 (GOTO -> Settings for Batch Manager -> No. Of Parallel Processes )

3) Changed the Job Class to "A"

4) Selected checkboxes 'Get All New Data request by Request and Retrieve Until No More New Data' in Extraction tab of DTP

However still DTP load performance gasn't improved.

Please suggest how to improve DTP performance in my case

Regards

Mohit

[former_member416151]

Hello,

If the issue still could not be resolved, please have a look at th recently released guided answer for DTP perforamance:
Guided Answers: Data Transfer Process (DTP) performance/memory issues

Best Regards,
Jiandong

[Former Member]

Hi Mohit,

Is your issue resolved?

Sorry for re initiating this thread after so long but I am facing the same problem. please let me know the solution u incorporated for your system.

[former_member207826]

You may also check the following link:

[Performance Tips for Data Transfer Processes|http://help.sap.com/saphelp_NW70EHP1core/helpdata/en/47/e8c56ecd313c86e10000000a42189c/content.htm]

[Former Member]

Hi,

Please check which step in the data load is taking maximum time e.g. extraction or writing to the target etc to nail down the exact issue.

Thanks,

Mayuri

[Former Member]

Furthur Detailed Analysis:

I have observed (from previous data loads) that if records are less than 100,000, then DTP load is completed in about 2 minutes. However when records cross 100000 mark (say 110000), the It takes about 90 minutes to 2 hours for DTP load completion.

We are using Generic datasource to extract master data texts from R/3 system.

The data load steps (DTP data packet), along with time taken are as follows:

1) Extraction from datasource -> (Time Taken - 18 mins)

2) Filter Out New Records with same key -> (Time Taken - 2 seconds )

3) Writing from Data Source to Target (RSDS <datasource name> -> IOBJ <info object name>) -> (Time Taken - 105 minutes)

4) Updating Texts for info objects -> (Time taken - 2 seconds)

Hence time is consumned in Step 1 and Step 3.

Plz suggest how to improve DTP Load performance

[sven_mader2]

>1) Extraction from datasource -> (Time Taken - 18 mins)

what is your data source: PSA or ERP?

to read 18 min from PSA -> it's not possible.

=> so check your coding in the datasource in ERP!

>3) Writing from Data Source to Target (RSDS <datasource name> -> IOBJ <info object name>) -> (Time Taken - 105 minutes)

do you have routines in your transformations? check it!

Sven

[former_member207826]

It would be better to find out in the process chain logs and in the batch job logs, to see where exactly it is getting stuck at.

Considering it runs well in the dialog, maybe you should check the batch job availability in your system.

[Former Member]

Hi Paulo,

The load takes long time in following steps of Data Packet in DTP Monitor:

1) Extraction Datasource <datasource name> (about 17 minutes)

2) RSDS <datasource name> -> IOBJ <info object name> (about 1 hour 50 mins)

Regards

Mohit

Edited by: Mohit Gupte on Sep 27, 2010 10:33 AM

[sap_cohort]

It's important to include the <datasource name> and OBJ <info object name> to help determine the problem. You will not be giving out any trade secrets by doing so... Good Luck