Wily Introscope issue

[Former Member]

Hi All,

We are unable to start Wily Introscope manager.Once start generating Java heap dump and went to down status.Please find the Log file details below and give your suggestion to resolve this issue.

Module=/usr/sap//wilyintroscope/jre/bin/libj9jit23.so

Module_base_address=0900000004620000

Target=2_30_20071004_14218_BHdSMr (AIX 6.1)

CPU=ppc64 (16 logical CPUs) (0x980000000 RAM)

JVMDUMP006I Processing Dump Event "gpf", detail "" - Please Wait.

JVMDUMP007I JVM Requesting System Dump using '/usr/sap/<SID>/wilyintroscope/core.20140724.183547.26476614.dmp'

JVMDUMP010I System Dump written to /usr/sap/<SID>/wilyintroscope/core.20140724.183547.26476614.dmp

JVMDUMP007I JVM Requesting Snap Dump using '/usr/sap/<SID>/wilyintroscope/Snap0002.20140724.183547.26476614.trc'

JVMDUMP010I Snap Dump written to /usr/sap/<SID>/wilyintroscope/Snap0002.20140724.183547.26476614.trc

JVMDUMP007I JVM Requesting Java Dump using '/usr/sap/<SID>/wilyintroscope/javacore.20140724.183547.26476614.txt'

JVMDUMP012E Error in Java Dump: /usr/sap/<SID>/wilyintroscope/javacore.20140724.183547.26476614.txt

JVMDUMP013I Processed Dump Event "gpf", detail "".

JVMJ9GC028E Option too large: '-Xmx4096m'

JVMJ9VM015W Initialization error for library j9gc23(2): Failed to initialize; unable to parse command line

Could not create the Java virtual machine.

Regards,

MK

[divyanshu_srivastava3 · Accepted solution]

Hi MK,

can you check /usr/sap/<SID>/wilyintroscope/javacore.20140724.183547.26476614.txt

Also adapt the file Introscope_Enterprise_Manager.lax in the EM home directory. Property lax.nl.java.option.additional contains all JVM parameters. For Java heap size see Java parameter -Xmx and -Xms. Make Xms and Xmx equal to 1024.

Divyanshu

[Former Member · Accepted solution]

Hi,

Plz find the java core details below.

NULL           ------------------------------------------------------------------------

0SECTION       TITLE subcomponent dump routine

NULL           ===============================

1TISIGINFO     Dump Event "gpf" (00002000) received

1TIDATETIME    Date:                 2014/07/24 at 18:36:07

1TIFILENAME    Javacore filename:    /usr/sap/<SID>/wilyintroscope/javacore.20140724.183547.26476614.txt

NULL           ------------------------------------------------------------------------

0SECTION       GPINFO subcomponent dump routine

NULL           ================================

2XHOSLEVEL     OS Level         : AIX 6.1

2XHCPUS        Processors -

3XHCPUARCH       Architecture   : ppc64

3XHNUMCPUS       How Many       : 16

NULL

1XHEXCPCODE    J9Generic_Signal_Number: 0000000000000004

1XHEXCPCODE    Signal_Number: 000000000000000B

1XHEXCPCODE    Error_Value: 0000000000000000

1XHEXCPCODE    Signal_Code: 0000000000000033

1XHEXCPCODE    Handler1: 09001000A0C39D58

1XHEXCPCODE    Handler2: 09001000A0C31E38

NULL

1XHEXCPMODULE  Module: /usr/sap/<SID>/wilyintroscope/jre/bin/libj9jit23.so

1XHEXCPMODULE  Module_base_address: 0900000004620000

NULL

1XHREGISTERS   Registers:

2XHREGISTER      R0:0000000000000002

2XHREGISTER      R1:0FFFFFFFFFFFE150

2XHREGISTER      R2:0000000000000002

2XHREGISTER      R3:0000000000000002

2XHREGISTER      R4:0000000000000002

2XHREGISTER      R5:07000000002982C8

2XHREGISTER      R6:0000000115E80F09

2XHREGISTER      R7:0000000000000018

2XHREGISTER      R8:0000000115F565B0

2XHREGISTER      R9:0000000115D1B089

2XHREGISTER      R10:FFFFFFFFFFFFFFFF

2XHREGISTER      R11:0900000004654EB0

2XHREGISTER      R12:000000011A1B7E9F

2XHREGISTER      R13:0000000110011200

0SECTION       ENVINFO subcomponent dump routine

NULL           =================================

1CIJAVAVERSION J2RE 5.0 IBM J9 2.3 AIX ppc64-64 build j9vmap6423-20071007

1CIVMVERSION   VM build 20071004_14218_BHdSMr

1CIJITVERSION  JIT enabled - 20070820_1846ifx1_r8

1CIRUNNINGAS   Running as a standalone JVM

1CICMDLINE     ./jre/bin/java -Xms512m -Xmx4096m -Djava.awt.headless=true -Dsun.java2d.noddraw=true -Dorg.osgi.framework.bootdelegation=org.apache.xpath com.zerog.lax.L

AX /usr/sap/<SID>/wilyintroscope/bin/../Introscope_Enterprise_Manager.lax /tmp/env.properties.26476614

1CIJAVAHOMEDIR Java Home Dir:   /usr/sap/<SID>/wilyintroscope/jre

1CIJAVADLLDIR  Java DLL Dir:    /usr/sap/<SID>/wilyintroscope/jre/bin

1CISYSCP       Sys Classpath:   /usr/sap/<SID>/wilyintroscope/jre/lib/vm.jar;/usr/sap/<SID>/wilyintroscope/jre/lib/core.jar;/usr/sap/<SID>/wilyintroscope/jre/lib/charsets.jar

;/usr/sap/<SID>/wilyintroscope/jre/lib/graphics.jar;/usr/sap/<SID>/wilyintroscope/jre/lib/security.jar;/usr/sap/<SID>/wilyintroscope/jre/lib/ibmpkcs.jar;/usr/sap/<SID>/wilyintr

oscope/jre/lib/ibmorb.jar;/usr/sap/<SID>/wilyintroscope/jre/lib/ibmcfw.jar;/usr/sap/<SID>/wilyintroscope/jre/lib/ibmorbapi.jar;/usr/sap/<SID>/wilyintroscope/jre/lib/ibmjcefw.

jar;/usr/sap/<SID>/wilyintroscope/jre/lib/ibmjgssprovider.jar;/usr/sap/<SID>/wilyintroscope/jre/lib/ibmjsseprovider2.jar;/usr/sap/<SID>/wilyintroscope/jre/lib/ibmjaaslm.jar;/

usr/sap/<SID>/wilyintroscope/jre/lib/ibmcertpathprovider.jar;/usr/sap/<SID>/wilyintroscope/jre/lib/server.jar;/usr/sap/<SID>/wilyintroscope/jre/lib/xml.jar;

1CIUSERARGS    UserArgs:

2CIUSERARG               -Xmx256M

2CIUSERARG               -Xj9

2CIUSERARG               -Xjcl:jclscar_23

2CIUSERARG               -Dcom.ibm.oti.vm.bootstrap.library.path=/usr/sap/<SID>/wilyintroscope/jre/bin

2CIUSERARG               -Dsun.boot.library.path=/usr/sap/<SID>/wilyintroscope/jre/bin

2CIUSERARG               -Djava.library.path=/usr/sap/<SID>/wilyintroscope/jre/bin:/usr/sap/<SID>/wilyintroscope/jre/bin:/usr/sap/<SID>/wilyintroscope/jre/bin/classic:/usr/sa

p/<SID>/wilyintroscope/jre/bin:/usr/sap/<SID>/SYS/exe/run:/usr/sap/<SID>/wilyintroscope/jre/bin/j9vm:/usr/lib

2CIUSERARG               -Djava.home=/usr/sap/<SID>/wilyintroscope/jre

2CIUSERARG               -Djava.ext.dirs=/usr/sap/<SID>/wilyintroscope/jre/lib/ext

2CIUSERARG               -Duser.dir=/usr/sap/<SID>/wilyintroscope

2CIUSERARG               _j2se_j9=70912 0x09001000A048F3E8

2CIUSERARG               vfprintf 0x0000000110001910

2CIUSERARG               -Xms512m

2CIUSERARG               -Xmx4096m

2CIUSERARG               -Djava.awt.headless=true

2CIUSERARG               -Dsun.java2d.noddraw=true

2CIUSERARG               -Dorg.osgi.framework.bootdelegation=org.apache.xpath

2CIUSERARG               -Dinvokedviajava

2CIUSERARG               -Djava.class.path=/usr/sap/<SID>/wilyintroscope/bin/../launcher.jar:/usr/sap/<SID>/wilyintroscope/bin/../lax.jar:

2CIUSERARG               vfprintf

2CIUSERARG               _port_library 0x09001000A048FDF0

2CIUSERARG               -Xdump

Regards,

MK

[divyanshu_srivastava3 · Accepted solution]

The problem seems to be caused by "JVMJ9GC028E Option too large: '-Xmx4096m'".

Reduce your max heap size to 1024m and try to restart Wily.

Divyanshu

[Former Member · Accepted solution]

Thanks for your reply.I have provided the current parameter below. Please advise how to change this parameter to 1024.

lax.nl.java.option.additional=-Xms512m -Xmx4096m -Djava.awt.headless=true -Dsun.java2d.noddraw=true -Dorg.osgi.framework.bootdelegation=org.apache.xpath

Regards,

MK

[divyanshu_srivastava3 · Accepted solution]

just replace 4096 with 1024

save it and restart.

[Former Member · Accepted solution]

Hi,

After changing this parameter also facing java core and heap dump issue.

Current Value:lax.nl.java.option.additional=-Xms512m -Xmx1024m -Djava.awt.headless=true -Dsun.java2d.noddraw=true -Dorg.osgi.framework.bootdelegation=org.apache.xpath

Module=/usr/sap/<SID>/wilyintroscope/jre/bin/libj9jit23.so

Module_base_address=09000000009A2000

Target=2_30_20071004_14218_BHdSMr (AIX 6.1)

CPU=ppc64 (16 logical CPUs) (0x980000000 RAM)

JVMDUMP006I Processing Dump Event "gpf", detail "" - Please Wait.

JVMDUMP007I JVM Requesting System Dump using '/usr/sap/<SID>/wilyintroscope/core.20140724.205042.18022558.dmp'

JVMDUMP010I System Dump written to /usr/sap/<SID>/wilyintroscope/core.20140724.205042.18022558.dmp

JVMDUMP007I JVM Requesting Snap Dump using '/usr/sap/<SID>/wilyintroscope/Snap0002.20140724.205042.18022558.trc'

JVMDUMP010I Snap Dump written to /usr/sap/<SID>/wilyintroscope/Snap0002.20140724.205042.18022558.trc

JVMDUMP007I JVM Requesting Java Dump using '/usr/sap/<SID>/wilyintroscope/javacore.20140724.205042.18022558.txt'

JVMDUMP012E Error in Java Dump: /usr/sap/<SID>/wilyintroscope/javacore.20140724.205042.18022558.txt

JVMDUMP013I Processed Dump Event "gpf", detail "".

Regards,

MK

[divyanshu_srivastava3 · Accepted solution]

change xms to 1024 and try again.

[Former Member · Accepted solution]

Hi,

Still facing same issue.

Currnt Value:

lax.nl.java.option.additional=-Xms1024m -Xmx1024m -Djava.awt.headless=true -Dsun.java2d.noddraw=true -Dorg.osgi.framework.bootdelegation=org.apache.xpath

FPR31 0000000000000000 (f: 0.000000, d: 0.000000e+00)

Module=/usr/sap/<SID>/wilyintroscope/jre/bin/libj9jit23.so

Module_base_address=09000000009A2000

Target=2_30_20071004_14218_BHdSMr (AIX 6.1)

CPU=ppc64 (16 logical CPUs) (0x980000000 RAM)

JVMDUMP006I Processing Dump Event "gpf", detail "" - Please Wait.

JVMDUMP007I JVM Requesting System Dump using '/usr/sap/<SID>/wilyintroscope/core.20140724.210353.20250744.dmp'

JVMDUMP010I System Dump written to /usr/sap/<SID>/wilyintroscope/core.20140724.210353.20250744.dmp

JVMDUMP007I JVM Requesting Snap Dump using '/usr/sap/<SID>/wilyintroscope/Snap0002.20140724.210353.20250744.trc'

JVMDUMP010I Snap Dump written to /usr/sap/<SID>/wilyintroscope/Snap0002.20140724.210353.20250744.trc

JVMDUMP007I JVM Requesting Java Dump using '/usr/sap/<SID>/wilyintroscope/javacore.20140724.210353.20250744.txt'

JVMDUMP012E Error in Java Dump: /usr/sap/<SID>/wilyintroscope/javacore.20140724.210353.20250744.txt

JVMDUMP013I Processed Dump Event "gpf", detail "".

Standard input: END

Regards,

MK

[divyanshu_srivastava3 · Accepted solution]

Problem seems to be with AIX and JVM you are using.

Please update to sapjvm and update wily, if not.

[Former Member · Accepted solution]

Yes. Issue resolved after changing Java path.

Thanks

MK

[Former Member · Accepted solution]

Hi Jayaram,

    I am facing the same problem. Please tell me where to change the java path and what path to set ?

Thanks

Vikram.