on 10-09-2014 12:21 PM
Hello,
It's a random problem that we are facing but it now it is happening quite frequently.
In our process chains, serial execution of 10 Info-Packages takes places and each one of them takes on an average 20 minutes max. to fetch data.
Lately, what has happened that one of them took 5 hours to fetch the data, after that two more took 1 hour 20 and 1 hour 35 minutes respectively.
It has happened one or two times previous weeks also.
Please let me know what steps/sequence to follow/monitor with details during IP getting stuck with 0 of 0 records. What can I suggest to the basis team for the same ? Where can I check IP logs/Job Overview ?
Regards,
Max
Good question! We had a similar issue in the past, most probable reason we found out is due to system backup running in parallel or it might be scheduled to run on specific days, ask Basis team to check system and organize backup schedule days.
You may also check BW system backup trigger times within past few weeks. Tcode DB02 will provide more info.
Hope this helps.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi WIDYL,
I am trying to get in touch with Basis team but there availability is also an issue. Data source is direct access , accessing the operational data, we have 10 info packages for each month and at around 10:20:00 pm, any info package ready to run during that point in time, goes on waiting from 2 - 5 hours . I have checked this datasource in ECC system and it doesn't exists and it's origin is BI system only,
Through customer exit it is getting the data. I have some difficulty understanding the system as I am new to this support project and documentation etc. is not there.
Regards,
Max
Hi Max,
First of all don't panic its a silly system where we have to give instruction in order to perform something. You need to create documentation if possible to understand the system. If its a support environment its a must to create these.
Try to replicate the same scenario in Quality system if possible, Basis needs involvement as the data was retrieved directly from source, they need to trace if there are timing issues or background job processing issue.
Check info-package wait times as well.
Is this info packages are executed sequentially or in parallel?
Kind regards.
Here is the partial log from SM37,
Please note after 10 : 22 : 44 PM , processes started again after 3:18:XX AM..???? It went idle ?
10/8/2014 | 10:22:44 PM | Job started | 00 | 516 | S |
10/8/2014 | 10:22:44 PM | Step 001 started (program SBIE0001, variant &0000000007558, user ID ALEREMOTE) | 00 | 550 | S |
10/8/2014 | 10:22:44 PM | Asynchronous transmission of info IDoc 2 in task 0001 (0 parallel tasks) | R3 | 413 | S |
10/8/2014 | 10:22:44 PM | DATASOURCE = ZBW******* | R3 | 299 | S |
10/8/2014 | 10:22:44 PM | RLOGSYS = **************** | R3 | 299 | S |
10/8/2014 | 10:22:44 PM | REQUNR = RE***********************EJNVC0R | R3 | 299 | S |
10/8/2014 | 10:22:44 PM | UPDMODE = F | R3 | 299 | S |
10/8/2014 | 10:22:44 PM | LANGUAGES = * | R3 | 299 | S |
10/8/2014 | 10:22:44 PM | ************************************************************************* | R8 | 48 | S |
10/8/2014 | 10:22:44 PM | * Current Values for Selected Profile Parameters * | R8 | 49 | S |
10/8/2014 | 10:22:44 PM | ************************************************************************* | R8 | 48 | S |
10/8/2014 | 10:22:44 PM | * abap/heap_area_nondia......... 7000000000 * | R8 | 50 | S |
10/8/2014 | 10:22:44 PM | * abap/heap_area_total.......... 10000000000 * | R8 | 50 | S |
10/8/2014 | 10:22:44 PM | * abap/heaplimit................ 40000000 * | R8 | 50 | S |
10/8/2014 | 10:22:44 PM | * zcsa/installed_languages...... DEF * | R8 | 50 | S |
10/8/2014 | 10:22:44 PM | * zcsa/system_language.......... E * | R8 | 50 | S |
10/8/2014 | 10:22:44 PM | * ztta/max_memreq_MB............ 2047 * | R8 | 50 | S |
10/8/2014 | 10:22:44 PM | * ztta/roll_area................ 15000000 * | R8 | 50 | S |
10/8/2014 | 10:22:44 PM | * ztta/roll_extension........... 2000000000 * | R8 | 50 | S |
10/8/2014 | 10:22:44 PM | ************************************************************************* | R8 | 48 | S |
10/9/2014 | 3:18:07 AM | Call customer enhancement EXIT_SAPLRSAP_001 (CMOD) with 12.987 records | R3 | 407 | S |
10/9/2014 | 3:18:07 AM | Result of customer enhancement: 12.987 records | R3 | 408 | S |
10/9/2014 | 3:18:07 AM | PSA=1 USING SMQS SCHEDULER / IF [tRFC=ON] STARTING qRFC ELSE STARTING SAPI | R3 | 299 | S |
10/9/2014 | 3:18:07 AM | Asynchronous send of data package 1 in task 0002 (1 parallel tasks) | R3 | 409 | S |
10/9/2014 | 3:18:07 AM | tRFC: Data Package = 0, TID = , Duration = 00:00:00, ARFCSTATE = | R3 | 38 | S |
10/9/2014 | 3:18:07 AM | tRFC: Start = 08.10.2014 22:22:44, End = 08.10.2014 22:22:44 | R3 | 39 | S |
10/9/2014 | 3:18:08 AM | Asynchronous transmission of info IDoc 3 in task 0003 (1 parallel tasks) | R3 | 413 | S |
10/9/2014 | 3:18:08 AM | Call customer enhancement EXIT_SAPLRSAP_001 (CMOD) with 12.987 records | R3 | 407 | S |
10/9/2014 | 3:18:08 AM | Result of customer enhancement: 12.987 records | R3 | 408 | S |
10/9/2014 | 3:18:09 AM | tRFC: Data Package = 0, TID = , Duration = 00:00:01, ARFCSTATE = | R3 | 38 | S |
10/9/2014 | 3:18:09 AM | tRFC: Start = 09.10.2014 03:18:08, End = 09.10.2014 03:18:09 | R3 | 39 | S |
10/9/2014 | 3:18:09 AM | Asynchronous send of data package 2 in task 0004 (1 parallel tasks) | R3 | 409 | S |
10/9/2014 | 3:18:09 AM | tRFC: Data Package = 1, TID = 995FD19B3A80543636AF0632, Duration = 00:00:02, ARFCSTATE = SENDED | R3 | 38 | S |
10/9/2014 | 3:18:09 AM | tRFC: Start = 09.10.2014 03:18:07, End = 09.10.2014 03:18:09 | R3 | 39 | S |
10/9/2014 | 3:18:10 AM | tRFC: Data Package = 2, TID = 995FD19B18D0543636B1045F, Duration = 00:00:01, ARFCSTATE = RECORDED | R3 | 38 | S |
10/9/2014 | 3:18:10 AM | tRFC: Start = 09.10.2014 03:18:09, End = 09.10.2014 03:18:10 | R3 | 39 | S |
10/9/2014 | 3:18:10 AM | Asynchronous transmission of info IDoc 4 in task 0005 (0 parallel tasks) | R3 | 413 | S |
10/9/2014 | 3:18:10 AM | Call customer enhancement EXIT_SAPLRSAP_001 (CMOD) with 12.987 records | R3 | 407 | S |
10/9/2014 | 3:18:10 AM | Result of customer enhancement: 12.987 records | R3 | 408 | S |
10/9/2014 | 3:18:10 AM | Asynchronous send of data package 3 in task 0006 (1 parallel tasks) | R3 | 409 | S |
10/9/2014 | 3:18:10 AM | tRFC: Data Package = 0, TID = , Duration = 00:00:00, ARFCSTATE = | R3 | 38 | S |
10/9/2014 | 3:18:10 AM | tRFC: Start = 09.10.2014 03:18:10, End = 09.10.2014 03:18:10 | R3 | 39 | S |
10/9/2014 | 3:18:11 AM | tRFC: Data Package = 3, TID = 995FD19B18D0543636B20460, Duration = 00:00:01, ARFCSTATE = RECORDED | R3 | 38 | S |
10/9/2014 | 3:18:11 AM | tRFC: Start = 09.10.2014 03:18:10, End = 09.10.2014 03:18:11 | R3 | 39 | S |
10/9/2014 | 3:18:11 AM | Asynchronous transmission of info IDoc 5 in task 0007 (0 parallel tasks) | R3 | 413 | S |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi Max
This has to be notified to Basis team as well when you are analysing further.
It seems to be a full load and it hits CMOD for some logics. Hope you haven't changed anything in CMOD code to have the logic very complex.
Try reducing the data packet size if the code is complex by the below path. IP -> Schedule(Menu) -> Data transfer for source system -> reduce the data packet size and increase the maximum number of dialog processes of sending data.
Try this change the load the data again. Meanwhile keep basis informed and let them also analyse if there is no change in code part
Regards
Karthik
Better to change your info pack trigger time and see the result.
it may run without much delay.
If you see your logs you will find below info.
Before starting of CMOD code, it tooks 4 to 5hrs to call CMOD logic.
So in that gap your ECC system will be overloaded.
so ask basis team and trace the ECC load in that time period.
You may get some idea about.
About BGDs, you can see at SM50 or SM51.
if you have very less bgd then ask basis team to increase more as per the needs.
Try to schedule your full info pack load where less burden on ecc/bw servers.
Hi Max
When the infopackage is triggered, it needs a background process in BI side and only when that job is completed, the extraction job will be initiated in source system.
In source system, a background process starts referring to your infopackage and in your case, it has started around 10 pm. Later when the data is passed from ECC to BI as TRFCs, it required dialog process for each TRFC
But in your case, the job has started and it got stopped before extracting the data. So this not related to lack of process, I believe.
As you have mentioned, monitor this for few days when the job is actually running. Inform Basis team to track the job when its actually running in the system. They will know how to check what is the job actually doing. meaning it can try to hit a database or something like that
Regards
Karthik
Hi Karthik,
One of the IPs loading again got stuck and it hasn't call the CMOD code yet and it's still waiting, But on checking on SM50 on BI system I can see some activity in DIA .
Please let me know what further things I can do like if manual process of IDOCs etc I can try or any other thing ?
Thanks and regards,
Max
10/9/2014 | 10:28:20 PM | Job started | 00 | 516 | S |
10/9/2014 | 10:28:20 PM | Step 001 started (program SBIE0001, variant &0000000007570, user ID ALEREMOTE) | 00 | 550 | S |
10/9/2014 | 10:28:20 PM | Asynchronous transmission of info IDoc 2 in task 0001 (0 parallel tasks) | R3 | 413 | S |
10/9/2014 | 10:28:20 PM | DATASOURCE = Z**_TRANS | R3 | 299 | S |
10/9/2014 | 10:28:20 PM | RLOGSYS = ***************** | R3 | 299 | S |
10/9/2014 | 10:28:20 PM | REQUNR = R*********************** | R3 | 299 | S |
10/9/2014 | 10:28:20 PM | UPDMODE = F | R3 | 299 | S |
10/9/2014 | 10:28:20 PM | LANGUAGES = * | R3 | 299 | S |
10/9/2014 | 10:28:20 PM | ************************************************************************* | R8 | 48 | S |
10/9/2014 | 10:28:20 PM | * Current Values for Selected Profile Parameters * | R8 | 49 | S |
10/9/2014 | 10:28:20 PM | ************************************************************************* | R8 | 48 | S |
10/9/2014 | 10:28:20 PM | * abap/heap_area_nondia......... 7000000000 * | R8 | 50 | S |
10/9/2014 | 10:28:20 PM | * abap/heap_area_total.......... 10000000000 * | R8 | 50 | S |
10/9/2014 | 10:28:20 PM | * abap/heaplimit................ 40000000 * | R8 | 50 | S |
10/9/2014 | 10:28:20 PM | * zcsa/installed_languages...... DEF * | R8 | 50 | S |
10/9/2014 | 10:28:20 PM | * zcsa/system_language.......... E * | R8 | 50 | S |
10/9/2014 | 10:28:20 PM | * ztta/max_memreq_MB............ 2047 * | R8 | 50 | S |
10/9/2014 | 10:28:20 PM | * ztta/roll_area................ 15000000 * | R8 | 50 | S |
10/9/2014 | 10:28:20 PM | * ztta/roll_extension........... 2000000000 * | R8 | 50 | S |
10/9/2014 | 10:28:20 PM | ************************************************************************* | R8 | 48 | S |
Hi Raman,
No use of scheduling to different time because there are like 10 IPs and this happens to any one of them at any point in time.
Please see my latest reply and if you can find anything it.
You said I should get the BGDs checked for in SM50. I have checked in SM50 on BI side and there are 12..with 2 running and rest on waiting so I guess that's not an issue from BI side.
But on the ECC side, there are only 5 BGDs and one is in waiting and rest are full loaded. So should I get the BGDs checked for ECC first ?
Thanks a lot
Regards,
Max
Hi Karthik,
I have done some checking of logs and almost around after 10:20:00 - 10:50:00 PM this problem starts with any IP that is ready to start in this time period. I guess it's the overloading of ECC system or something like that which Basis team should check for BGD processes etc.
Thanks and regards,
Max
Yes Max. You are absolutely correct. Please inform basis team to check these job logs and investigate further.
You may also recommend them to increase the background processes in ECC system. To confirm its an issue with unavailablity of resource,you can also try running only one infopackage at a time to see if thats working fine. Just to make a point that it works when there are free resources.
Hope this helps
Regards
Karthik
Hi Max
This is not an easy task to trace and identify the reason.
We can get the tcode to do tracing and we can do that as well. But we wont be able to understand it properly. Unless we understand what is happening in the background, how could we resolve the issue.
ST12 is the tcode to initiate the trace, but I am not how useful it is when we (BI consultant) do it. I am not sure how to use this effectively as well.
Did you try running only one infopackage during different timing?
Regards
Karthik
Hi Karthik
I have checked using SM50 in ECC, BGD processes is not an issue.
I have done step by step analysis in IP, Posting some screenshots, if something can be extracted from that . Please see :
Job Overview is same as the above logs I had pasted earlier .
Checking in SM58, it's empty
Source system is pointing to BI system only.
I have checked the datasource and Info Package, In extraction the adapter is access SAP data through service API.
Where should the data be coming from ? I guess it's a real time data access.
Hi Max
There are various parameters that we need to check for the performance of infopackage. On the other hand, check the data volume as well.
The problem might be with tRFCs getting piled up in source system or the BGD process availability in BW system or the dialog processes available in source system to transact RFCs
When you go to the process monitor when the infopackage is running, click on Environment in the menu bar --> Job Overview in data warehouse and source system; Transact RFC in source system.
Compare the job logs when it ran fast and current log. you will get an idea if its an issue with jobs
If its a RFC issue, you can just go to SM58 in source system and execute the TRFCs which are in recorded mode by clicking F6.
Regards
Karthik
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi,
info pack job log you can see at ECC side if your loading data from ECC.
check at info pack monitor screen and details tab.
IP getting 0 of 0 records - mean source don't have data. in such case we need to turns that status to green by using below option.
Go to your info pack, Menu scheduler-->Color of traffic light for empty request, here yellow may be selected, select green and save it.
Next time onwards whenever IP get 0 records it turns to green without much delay.
Thanks
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
User | Count |
---|---|
87 | |
10 | |
10 | |
9 | |
7 | |
7 | |
6 | |
5 | |
4 | |
4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.