In our applications we are using VS 2005, SQL Server 2008 and Cyrstal reports for .NET framework 2.0. Our application is not responding to any requests and it is hanging for long time. While we are doing the memory dump analysis, we found that it was the issue with Crystal report Dlls. We have contacted Microsoft support team and they also confirmed that it was due to due to possible blocking or leaked critical section from the third-party assembly crpe32.dll and they will not support this.
Could someone please help me, why the issue is happening and what will be the workaround or permanent fix for this issue?
Note: As a temporary work arount, I am restarting the application pool whenever the issue happens.
Memory dump analysis result:
=========================
Issue Analysis
=========================
There are 7 threads blocked at crpe32!SetDialogFont
ChildEBP RetAddr Args to Child
18a98230 7748da8c 00000002 18a98280 00000001 ntdll!NtWaitForMultipleObjects+0x15 [e:\obj.x86fre\base\ntdll\wow6432\objfre\i386\usrstubs.asm @ 829]
18a982cc 75da8f86 18a98280 18a982f4 00000000 kernel32!WaitForMultipleObjectsEx+0x11d [d:\vistasp2_gdr\base\win32\client\synch.c @ 1810]
18a98320 75da8fcf 000009dc 18a98380 ffffffff user32!RealMsgWaitForMultipleObjectsEx+0x14d [d:\longhorn\windows\core\ntuser\client\client.c @ 1695]
18a9833c 3a9b0b25 00000001 18a98380 00000000 user32!MsgWaitForMultipleObjects+0x1f [d:\longhorn\windows\core\ntuser\client\client.c @ 1574]
WARNING: Stack unwind information not available. Following frames may be wrong.
18a9835c 3a7d842e ffffffff 00000000 000004ff crpe32!SetDialogFont+0x448c1
18a983fc 3a7dcd19 00000001 124c7c40 18a98450 crpe32!CRPEConnectionInit+0x1b8e5f
18a9841c 3a5b39dc 18a98450 125088a0 18a98504 crpe32!CRPEConnectionInit+0x1bd74a
18a98434 3a5e0f51 18a98450 17d64963 0000058a crpe32!PESetSectionHeight+0x6d
18a98dbc 005c003a 00690057 0064006e 0077006f crpe32!PESetLogonProperty+0x47f
18a98dc0 00690057 0064006e 0077006f 005c0073 0x5c003a
18a98dc4 0064006e 0077006f 005c0073 00450054 0x690057
18a98dc8 0077006f 005c0073 00450054 0050004d 0x64006e
18a98dcc 005c0073 00450054 0050004d 0074005c 0x77006f
18a98dd0 00450054 0050004d 0074005c 006d0065 0x5c0073
.NET Call Stack
ESP EIP
18a9e180 77a69bd5 [ComPlusMethodFrameGeneric: 18a9e180] CrystalDecisions.ReportAppServer.ClientDoc.ReportClientDocumentClass.Open(System.Object ByRef, Int32) e:\obj.x86fre\base\ntdll\wow6432\objfre\i386\usrstubs.asm:829
18a9e194 113f3820 CrystalDecisions.ReportAppServer.ReportClientDocumentWrapper.Open(System.Object ByRef, Int32)
18a9e1cc 113f3648 CrystalDecisions.ReportAppServer.ReportClientDocumentWrapper.EnsureDocumentIsOpened()
18a9e20c 113f2c48 CrystalDecisions.CrystalReports.Engine.ReportDocument.Load(System.String, CrystalDecisions.Shared.OpenReportMethod, Int16)
18a9e24c 113f2383 CrystalDecisions.CrystalReports.Engine.ReportClass.Load(System.String, CrystalDecisions.Shared.OpenReportMethod, Int16)
18a9e29c 113f174d CrystalDecisions.CrystalReports.Engine.ReportDocument.EnsureLoadReport()
18a9e2c8 113f1661 CrystalDecisions.CrystalReports.Engine.ReportDocument.get_Database()
18a9e570 720d1b4c [CustomGCFrame: 18a9e570] f:\dd\ndp\clr\src\vm\i386\asmhelpers.asm:934
18a9e538 720d1b4c [GCFrame: 18a9e538] f:\dd\ndp\clr\src\vm\i386\asmhelpers.asm:934
18a9e554 720d1b4c [GCFrame: 18a9e554] f:\dd\ndp\clr\src\vm\i386\asmhelpers.asm:934
18a9e738 720d1b4c [HelperMethodFrame_1OBJ: 18a9e738] System.RuntimeMethodHandle._InvokeMethodFast(System.Object, System.Object[], System.SignatureStruct ByRef, System.Reflection.MethodAttributes, System.RuntimeTypeHandle) f:\dd\ndp\clr\src\vm\i386\asmhelpers.asm:934
18a9e7a8 0f0d9f25 System.RuntimeMethodHandle.InvokeMethodFast(System.Object, System.Object[], System.Signature, System.Reflection.MethodAttributes, System.RuntimeTypeHandle) f:\dd\ndp\clr\src\BCL\System\RuntimeHandles.cs:637
18a9e7f4 0f0d98b4 System.Reflection.RuntimeMethodInfo.Invoke(System.Object, System.Reflection.BindingFlags, System.Reflection.Binder, System.Object[], System.Globalization.CultureInfo, Boolean) f:\dd\ndp\clr\src\BCL\System\Reflection\XXXInfos.cs:1474
18a9e838 0f0d9760 System.Reflection.RuntimeMethodInfo.Invoke(System.Object, System.Reflection.BindingFlags, System.Reflection.Binder, System.Object[], System.Globalization.CultureInfo) f:\dd\ndp\clr\src\BCL\System\Reflection\XXXInfos.cs:1421
18a9e84c 112948a0 Microsoft.VisualBasic.CompilerServices.Symbols+Container.InvokeMethod(Method, System.Object[], Boolean[], System.Reflection.BindingFlags)
18a9e88c 1101c8b1 Microsoft.VisualBasic.CompilerServices.NewLateBinding.LateGet(System.Object, System.Type, System.String, System.Object[], System.String[], System.Type[], Boolean[])
18a9e8d0 111d38b0 CBA.RatesToday.Reports.Reporting.CreateReport(System.Object ByRef, System.String, System.String, Int32)
18a9e950 111d2e53 RatesToday.MMReports.ShowReport(System.String)
18a9ea9c 111d220e RatesToday.MMReports.lbMMIntRateSheet_Click(System.Object, System.EventArgs)
18a9ead0 111d1957 RatesToday.MMReports.Page_Load(System.Object, System.EventArgs)
18a9ebdc 10ff31a4 System.Web.UI.Control.OnLoad(System.EventArgs) f:\dd\ndp\fx\src\xsp\System\Web\UI\Control.cs:1798
18a9ebf0 10ff30b3 System.Web.UI.Control.LoadRecursive() f:\dd\ndp\fx\src\xsp\System\Web\UI\Control.cs:1813
18a9ec08 10ff0a93 System.Web.UI.Page.ProcessRequestMain(Boolean, Boolean) f:\dd\ndp\fx\src\xsp\System\Web\UI\Page.cs:4134
18a9ed68 10f0c0b7 System.Web.UI.Page.ProcessRequest(Boolean, Boolean) f:\dd\ndp\fx\src\xsp\System\Web\UI\Page.cs:3870
18a9eda0 10f0bfd8 System.Web.UI.Page.ProcessRequest() f:\dd\ndp\fx\src\xsp\System\Web\UI\Page.cs:3841
18a9edd8 10f01508 System.Web.UI.Page.ProcessRequestWithNoAssert(System.Web.HttpContext) f:\dd\ndp\fx\src\xsp\System\Web\UI\Page.cs:3812
18a9ede4 10f014a0 System.Web.UI.Page.ProcessRequest(System.Web.HttpContext) f:\dd\ndp\fx\src\xsp\System\Web\UI\Page.cs:3802
18a9edf8 102ff7c6 ASP.mmreports_aspx.ProcessRequest(System.Web.HttpContext)
18a9ee08 10f0131d System.Web.HttpApplication+CallHandlerExecutionStep.System.Web.HttpApplication.IExecutionStep.Execute() f:\dd\ndp\fx\src\xsp\System\Web\HttpApplication.cs:3360
18a9ee3c 10327ce5 System.Web.HttpApplication.ExecuteStep(IExecutionStep, Boolean ByRef) f:\dd\ndp\fx\src\xsp\System\Web\HttpApplication.cs:2190
18a9ee7c 10326857 System.Web.HttpApplication+ApplicationStepManager.ResumeSteps(System.Exception) f:\dd\ndp\fx\src\xsp\System\Web\HttpApplication.cs:3651
18a9eecc 103265e8 System.Web.HttpApplication.System.Web.IHttpAsyncHandler.BeginProcessRequest(System.Web.HttpContext, System.AsyncCallback, System.Object) f:\dd\ndp\fx\src\xsp\System\Web\HttpApplication.cs:1326
18a9eee4 0f60b3d9 System.Web.HttpRuntime.ProcessRequestInternal(System.Web.HttpWorkerRequest) f:\dd\ndp\fx\src\xsp\System\Web\HttpRuntime.cs:1611
18a9ef18 0f60b044 System.Web.HttpRuntime.ProcessRequestNoDemand(System.Web.HttpWorkerRequest) f:\dd\ndp\fx\src\xsp\System\Web\HttpRuntime.cs:2270
18a9ef28 0f60917a System.Web.Hosting.ISAPIRuntime.ProcessRequest(IntPtr, Int32) f:\dd\ndp\fx\src\xsp\System\Web\Hosting\ISAPIRuntime.cs:143
18a9f138 722184dd [ContextTransitionFrame: 18a9f138] f:\dd\ndp\clr\src\vm\comtoclrcall.cpp:476
18a9f16c 722184dd [GCFrame: 18a9f16c] f:\dd\ndp\clr\src\vm\comtoclrcall.cpp:476
18a9f2c8 722184dd [ComMethodFrame: 18a9f2c8] f:\dd\ndp\clr\src\vm\comtoclrcall.cpp:476
When the function is trying to enter the above critical section:
0:029> kb
ChildEBP RetAddr Args to Child
13a0e6ec 77a50177 00000780 00000000 00000000 ntdll!ZwWaitForSingleObject+0x15 [e:\obj.x86fre\base\ntdll\wow6432\objfre\i386\usrstubs.asm @ 133]
13a0e750 77a50142 00000000 00000000 00000000 ntdll!RtlpWaitOnCriticalSection+0x155 [d:\vistasp2_gdr\base\ntdll\resource.c @ 582]
13a0e778 3a5712fe 3ad1617c 1cdf2bcb 3ad16174 ntdll!RtlEnterCriticalSection+0x152 [d:\vistasp2_gdr\base\ntdll\resource.c @ 911]
WARNING: Stack unwind information not available. Following frames may be wrong.
13a0e7ac 3a999098 12508840 13a0e7e4 13a0e800 crpe32!Ordinal930+0x112fe
13a0e7c0 3a93e3cc ffffffff 00000000 3a93e3fe crpe32!SetDialogFont+0x2ce34
13a0e7cc 3a93e3fe 1cdf2467 3abc3208 12547798 crpe32!MWSetupPrinterW+0x14cf9e
00000000 00000000 00000000 00000000 00000000 crpe32!MWSetupPrinterW+0x14cfd0
We can see that the problematic assembly is owned by the third-party company Business Objects.
start end module name
3a560000 3ae83000 crpe32 (export symbols) crpe32.dll
Loaded symbol image file: crpe32.dll
Image path: C:\Program Files (x86)\Common Files\Business Objects\2.7\Bin\crpe32.dll
Image name: crpe32.dll
Timestamp: Thu Jan 11 22:52:30 2007 (45A64F2E)
CheckSum: 00921FEA
ImageSize: 00923000
File version: 10.2.0.1624
Product version: 10.2.0.0
File flags: 0 (Mask 3F)
File OS: 4 Unknown Win32
File type: 2.0 Dll
File date: 00000000.00000000
Translations: 1009.04b0
CompanyName: Business Objects
ProductName: Crystal Reports for .NET Framework 2.0
InternalName: CRPE
OriginalFilename: CRPE32.DLL
ProductVersion: 10.2.0.0
FileVersion: 10.2.0.1624
FileDescription: Crystal Reports Print Engine
LegalCopyright: Copyright © 1995-2007 Business Objects
Comments: Crystal Reports
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.