JCONTROL - dies with Error while connecting to DB

[pr_srinivas]

Hi....Experts

DB : Oracle 10.2.0.4.0

OS ; AIX 5.3

NW : 7.0 SP22

UT : EP

Yesterday the above server got rebooted by a power failure. after that

The server's DB is coming up as ora<sid> user, listener is also up

But as <sid>adm user - when i am starting . The jcotnrol dies and in thee work directory

....log_bootstrap_ID1168012.0.log fiel shows the below messages in the tail end,

================================================================

ERROR-1 : OBSERVED

================================================================

-

---

==[ Caused by: ]==----

---

com.sap.engine.frame.core.configuration.ConfigurationException: Error while connecting to DB.

at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnectionPool.createConnection(DBConnectionPool.java:365)

at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnectionPool.<init>(DBConnectionPool.java:130)

at com.sap.engine.core.configuration.impl.persistence.rdbms.PersistenceHandler.<init>(PersistenceHandler.java:38)

at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.<init>(ConfigurationCache.java:149)

at com.sap.engine.core.configuration.bootstrap.ConfigurationManagerBootstrapImpl.init(ConfigurationManagerBootstrapImpl.java:236)

at com.sap.engine.core.configuration.bootstrap.ConfigurationManagerBootstrapImpl.<init>(ConfigurationManagerBootstrapImpl.java:49)

at com.sap.engine.bootstrap.Synchronizer.<init>(Synchronizer.java:74)

at com.sap.engine.bootstrap.Bootstrap.initDatabaseConnection(Bootstrap.java:473)

at com.sap.engine.bootstrap.Bootstrap.<init>(Bootstrap.java:146)

at com.sap.engine.bootstrap.Bootstrap.main(Bootstrap.java:971)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:61)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:60)

at java.lang.reflect.Method.invoke(Method.java:391)

at com.sap.engine.offline.OfflineToolStart.main(OfflineToolStart.java:81)

Caused by: java.sql.SQLException: Io exception: There is no process to read data written to a pipe.

at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112)

at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:146)

at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:255)

at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:387)

at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:420)

at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:165)

at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:35)

at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:801)

at com.sap.sql.jdbc.NativeConnectionFactory.createNativeConnection(NativeConnectionFactory.java:215)

at com.sap.sql.connect.OpenSQLDataSourceImpl.createPooledConnection(OpenSQLDataSourceImpl.java:608)

at com.sap.sql.connect.OpenSQLDataSourceImpl.getPooledConnection(OpenSQLDataSourceImpl.java:285)

at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnectionPool.createConnection(DBConnectionPool.java:307)

... 15 more

[Feb 10, 2012 4:46:28 PM ] [Bootstrap module]> Problem occurred while performing synchronization.

================================================================

ERROR-2 : OBSERVED

================================================================

also i see error in work directory ...sapcpe.log as below

Host:d45adm> more sapcpe.log

2012/02/10 19:01:45

sapcpe version UC: @(#) $Id: //bas/700_REL/src/ccm/sapstart/sapxxcpe.c#20 $ SAP

Command line:

0: /usr/sap/D45/SYS/exe/run/sapcpe

1: name=D45

Trace level (profile): 1

• INFO: Try to find file table sapcpeft (default:sapcpeft)

• INFO: Try to find file table in the central directory /usr/sap/D45/SYS/exe/ctrun/sapcpeft

• INFO: not found any file table.

*************************************************

source: /usr/sap/D45/SYS/exe/ctrun

target: /usr/sap/D45/SYS/exe/run

*************************************************

• ERROR: sapcpe: find <src> /usr/sap/D45/SYS/exe/ctrun failed, 2, No such file or directory, [sapxxcpe.c:1464]

sapcpe.log: END

================================================================

any thoughts & advises, clues ???

Rgds

PR

[Former Member]

Srinivas,

first and foremost, please check if you were able to connect ConfigTool?

goto J2EE->ConfigTool and execute ConfigTool

say YES, when it prompt to choose 'Do you want to connect to default DB Settings'?

if it get connect sucessfully then we can start dig on other relevant items.

Regards

Sekhar

[pr_srinivas]

Hi....Sekhar

it is not connecting please

Also referred this note - But No luck

SAP Note 997510 - Troubleshooting J2EE Engine 6.40/7.0 Bootstrap Issues

Rgds

PR

[pr_srinivas]

Config tool also not connecting

Some recommendations like below referred ...But no luck yet

Option -A :: Reading the database connection configuration of J2EE Engine

-

---

http://help.sap.com/nw70

-> Technical Operations Guide

->Administration of SAP NetWeaver Systems

->AS Java (Application Server for Java)

->Management

->Tools

->Config Tool (on the right side)

Option -B :: Other Refered Notes

-

---

1. 00867176 - FAQ: Oracle JDBC

2. 00509719 - How to install Oracle JDBC Drivers

3. 00997510 - Troubleshooting J2EE Engine 6.40/7.0 Bootstrap Issues

4. 00764417 - Information for troubleshooting of the SAP J2EE Engine 6.40

5. 01024539 - Recommended Settings for NW04 >= SP14, NW 7.0 >= SP6 on AIX

6. 00739043 - How to Check for Full Strength Jurisdiction Policies

7. 01513450 - Configtool error - Cannot open secure store

Rgds

PR

[Former Member]

Hi,

Aren't able to see the securestore properties in the configtool?

Is configtool is getting exit as soon as you start it?

If yes, follow the instruction in the note

1513450 - Configtool error - Cannot open secure store

You just have to extract the SCA file and create a new configtool directory and open configtool and make the necessary changes.

Br,

Venky

[pr_srinivas]

Thanks Venky

We went thru this Note & were unlucky

Rgds

PR

[pr_srinivas]

ISSUE - RESOLVED

###################################################

####Summary######################################

###################################################

Key Word of this Issue :

Exception in thread "main" java.sql.SQLException: Io exception: There is no process to read data written to a pipe.

Reason

Name resolution by conflict / failure by netsvc.conf even we have hostfile & ping works with host name for Every user.

Solution

Adjusted netsvc.conf file to use the hostfile.

DETAILS OF RESOLUTION

OSS Experts asked me to copy the results

SAP Note No. 867176: FAQ: Oracle JDBC (JdbcCheckup) - Point 10

01. I copied JdbcCheckup.sar to location /home/sidadm/867176-jdbchkup/

02. Extracted the same in same foler with command : SAPCAR -xvf JdbcCheckup.sar

03. Now folder contained 2 files ""JdbcCheckup.java"" and "" JdbcCheckup.sar""

04. my JDBC driver file ojdbc14.jar is in location /oracle/client/10x_64/instantclient/

05. To determine the JDBC driver version issued the below command as per note

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

$Command : java -classpath /oracle/client/10x_64/instantclient/ojdbc14.jar:. JdbcCheckup

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

Please enter information to test connection to the database

user: SAPSR3DB

password: PASSWORD

database(a TNSNAME entry): SID

Hostname: portalserver

Port (1521): 1527

Connecting to the database...Connecting...

jdbc:oracle:thin:@portalserver:1527:SID, SAPSR3DB, PASSWORD

Exception in thread "main" java.sql.SQLException: Io exception: There is no process to read data written to a pipe.

at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112)

at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:146)

at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:255)

at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:387)

at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:441)

at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:165)

at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:35)

at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:801)

at java.sql.DriverManager.getConnection(DriverManager.java:559)

at java.sql.DriverManager.getConnection(DriverManager.java:189)

at JdbcCheckup.main(JdbcCheckup.java:128)

portalserver:sidadm>

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

06. Immediately id did google with above Syntax of error.

"""java.sql.SQLException: Io exception: There is no process to read data

written to a pipe"""

https://forums.oracle.com/forums/thread.jspa?threadID=1320173

which was referring about netsvc.conf

With UNIX Team discussions, adjusted the host file as first name

resolution source and DNS servers list followed in same(netsvc.conf) file. which

fixed the issue and "JdbcCheckup" passed.

07. JdbcCheckup Command - Passed output.

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

$Command : java -classpath /oracle/client/10x_64/instantclient/ojdbc14.jar:. JdbcCheckup

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

Command : java -classpath /oracle/client/10x_64/instantclient/ojdbc14.jar:. JdbcCheckup

Please enter information to test connection to the database

user: SAPSR3DB

password: PASSWORD

database(a TNSNAME entry): SID

Hostname: portalserver

Port (1521): 1527

Connecting to the database...Connecting...

jdbc:oracle:thin:@portalserver:1527:SID, SAPSR3DB, PASSWORD

connected.

=============

Database Product Name is ... Oracle

Database Product Version is Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production

With the Partitioning, Data Mining and Real Application Testing options

=============

JDBC Driver Name is ........ Oracle JDBC driver

JDBC Driver Version is ..... 10.2.0.4.0

=============

Hello World

Your JDBC installation is correct.

portalserver:sidadm>

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

BIG THANK TO EVERYONE !!!!!!!!!!!!!!!!

REGARDS

PR

[Former Member]

Srinivas,

Try this

Rename below files and try starting SAP again.

/usr/sap/<SID>/<INSTANCE>/j2ee/cluster/instance.properties.vmprop

/usr/sap/<SID>/<INSTANCE>/SDM/program/config/sdm_jstartup.properties.vmprop

Regards,

Arjun

[pr_srinivas]

Arjun........

Thank for your kind reply and throwing some light on this, To update current status

I tried first one already renaming - "instance.properties.vmprop"

by Note 1024539 - Recommended Settings for NW04 >= SP14, NW 7.0 >= SP6 on AIX - towards point #2 in SAP Note - Prepare the J2EE to detect the new JDK

But the second was not tried - i did it now renaming "sdm_jstartup.properties.vmprop " & Startup;

But - Unlucky...It (JCONTROL) dies with same reason.

Rgds

PR

[Former Member]

/usr/sap/D45/SYS/exe/ctrun failed, 2, No such file or directory, sapxxcpe.c:1464 - sapcpe.log: END

Can you please check above ctrun file or directory exists in the path.

[pr_srinivas]

Thanks again Arjun..

ctrun " neither directory nor file exists,

Normally CTRUN, We recalls like

DIR_CT_RUN = /usr/sap/<SID>/SYS/exe/run

Another Observations

...When i issue command, startsap (If db is down) it is ending,can not start db

...When i issue command, startsap (if db is up) it gives message as below

usr/sap/<SID>SYS/exe/run/startj2eedb completed successfully

i.e when db is up db is up recognised, but when db is down it is failig to startup the db.

*********thank..i keep posted, if i have any nes on this issue ********

Rgds

PR

[pr_srinivas]

###############################################

###When DB is up & When Issued "stopsap" command###

###############################################

/home/d45adm/stopdb.log

-

---

-

---

Sat Feb 11 23:19:21 IST 2012

LOGFILE FOR STOPPING ORACLE

Trying to stop D45 database ...

-

---

Sat Feb 11 23:19:21 IST 2012

checking required environment variables

ORACLE_HOME is >/oracle/D45/102_64<

ORACLE_SID is >D45<

-

---

Sat Feb 11 23:19:21 IST 2012

Connect to the database to check the database state:

-

---

Sat Feb 11 23:19:21 IST 2012

check if Oracle processes are running

Database is running

Continue with stop procedure

check_db_running finished with return code: 0

Database is running

Continue with stop procedure

-

---

Sat Feb 11 23:19:21 IST 2012

Forceing a log switch and then stop the database

SQL*Plus: Release 10.2.0.4.0 - Production on Sat Feb 11 23:19:21 2012

Copyright (c) 1982, 2007, Oracle. All Rights Reserved.

Connected.

System altered.

Connected.

Database closed.

Database dismounted.

ORACLE instance shut down.

Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production

With the Partitioning, Data Mining and Real Application Testing options

-

---

Sat Feb 11 23:19:37 IST 2012

Connect to the database to check the database state:

-

---

Sat Feb 11 23:19:37 IST 2012

check if Oracle processes are running

There are no Oracle processes running -

Database is probably already stopped.

check_db_running check finished with return code: 10

Database not available

Shutdown successfull

D45 database stopped

-

---

Sat Feb 11 23:19:37 IST 2012

checking V2 connect

[pr_srinivas]

#################################################

###When DB is down & When Issued "startsap" command###

#################################################

epsdcs1s:d45adm> /home/d45adm/startdb.log

ksh: /home/d45adm/startdb.log: 0403-006 Execute permission denied.

epsdcs1s:d45adm> more /home/d45adm/startdb.log

-

---

Sat Feb 11 23:26:35 IST 2012

LOGFILE FOR STARTING ORACLE

Trying to start D45 database ...

-

---

Sat Feb 11 23:26:35 IST 2012

checking required environment variables

ORACLE_HOME is >/oracle/D45/102_64<

ORACLE_SID is >D45<

-

---

Sat Feb 11 23:26:35 IST 2012

check initora

-

---

Sat Feb 11 23:26:35 IST 2012

check initora

-

---

Sat Feb 11 23:26:35 IST 2012

checking V2 connect

TNS Ping Utility for IBM/AIX RISC System/6000: Version 10.2.0.4.0 - Production on 11-FEB-2012 23:26:35

Copyright (c) 1997, 2007, Oracle. All rights reserved.

Used parameter files:

/usr/sap/D45/SYS/profile/oracle/sqlnet.ora

Used TNSNAMES adapter to resolve the alias

Attempting to contact (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (COMMUNITY = SAP.WORLD) (PROTOCOL = TCP) (HOST = epsdcs1s) (PORT = 1527))) (CONNECT_DATA = (SID = D45) (GLOBAL_NAME = D45.WORLD)))

OK (0 msec)

tnsping: V2 connect to D45

-

---

Sat Feb 11 23:26:35 IST 2012

Connect to the database to check the database state:

-

---

Sat Feb 11 23:26:35 IST 2012

check if Oracle processes are running

database not available

There are no Oracle processes running -

Database is probably already stopped.

check_db_running: check finished with return code: 10

Database not available

-

---

Sat Feb 11 23:26:35 IST 2012

Shutdown database

First trying to shutdown the database - May be,

the database is in the nomount or mount state

-

---

Sat Feb 11 23:26:35 IST 2012

starting database

SQL*Plus: Release 10.2.0.4.0 - Production on Sat Feb 11 23:26:35 2012

Copyright (c) 1982, 2007, Oracle. All Rights Reserved.

Connected to an idle instance.

ORA-00119: invalid specification for system parameter LOCAL_LISTENER

ORA-00132: syntax error or unresolved network name 'LISTENER_D45'

Disconnected

-

---

Sat Feb 11 23:29:06 IST 2012

Connect to the database to verify, that the database is now open

-

---

Sat Feb 11 23:29:06 IST 2012

check if Oracle processes are running

database not available

There are no Oracle processes running -

Database is probably already stopped.

• ERROR: Startup of database failed

Notify Database Administrator.

/usr/sap/D45/SYS/exe/run/startj2eedb: Terminating with error code 12

epsdcs1s:d45adm>

[Former Member]

Try to run saproot.sh...which you would after KERNEL upgrade and try again

[Former Member]

Hi,

As per your DB startup log you get, below errors

ORA-00119: invalid specification for system parameter LOCAL_LISTENER

ORA-00132: syntax error or unresolved network name 'LISTENER_D45'

Check if you have this listener entry in tnsnames.ora, also check if you are able to do tnsping to this listener name.

Warm Regards

Sujith

[pr_srinivas]

Arjun

Thanks again,

I tried a total KERNEL upgrade including all the followup commands including ./saproot.sh <SID>

But ....still Unlucky.

Rgds

PR

[pr_srinivas]

Hi..Experts any Thoughts

Some crack need to done

The SAP J2EE Engine stores the database user SAP<SID>DB, its password

\usr\sap\<SID>\SYS\global\security\data\SecStore.properties

\usr\sap\<SID>\SYS\global\security\data\SecStore.Key

• How to know are these files healthy or corrupted **

any clue...

We also have come across - 1 Note, Let met attempt this tomorrow.

SAP Note : 1602004 - J2EE System fails with "exitcode = 66"

Rgds

PR

[pr_srinivas]

#####################################

#####TNS ping results as <sid>adm########

#####################################

hostname:<sid>adm> tnsping <SID>.WORLD

TNS Ping Utility for IBM/AIX RISC System/6000: Version 10.2.0.4.0 - Production on 12-FEB-2012 21:23:37

Copyright (c) 1997, 2007, Oracle. All rights reserved.

Used parameter files:

/usr/sap/<SID>/SYS/profile/oracle/sqlnet.ora

Used TNSNAMES adapter to resolve the alias

Attempting to contact (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (COMMUNITY = SAP.WORLD) (PROTOCOL = TCP) (HOST = hostname) (PORT = 1527))) (CONNECT_DATA = (SID = SID) (GLOBAL_NAME = SID.WORLD)))

OK (0 msec)

hostanme:<sid>adm>

[Former Member]

Check your init.ora and make sure listener specified correctly. LOCAL_LISTENER or LISTERNER_D45 suppose to there ?

Refer to the forum

http://www.shutdownabort.com/errors/ORA-00119.php

http://forums.sdn.sap.com/thread.jspa?threadID=1258245

[pr_srinivas]

Arjun

as sidadm : tnsping SID.WORLD ...work in 0 ms.

Rgds

PR