cancel
Showing results for 
Search instead for 
Did you mean: 

SAP system getting hanged

Former Member
0 Kudos

Dear All,

My system is getting hanged after some time of starting. when i am checking at OS level by R3trans -d to check the connectivity between SAP & DB, it is also getting hanged. Plz let me know what should i do . this is the newly restored system from My PRD system ..

Ankit

Accepted Solutions (0)

Answers (2)

Answers (2)

former_member204746
Active Contributor
0 Kudos

database is in inconsistent state. check alert_[SID].log for more clues.

Former Member
0 Kudos

alert_PRD.log............

Sat Jun 20 08:29:33 2009
Shutting down instance: further logons disabled
Shutting down instance (immediate)
License high water mark = 10
Sat Jun 20 08:29:38 2009
ALTER DATABASE CLOSE NORMAL
Sat Jun 20 08:31:34 2009
ORA-1013 signalled during: ALTER DATABASE CLOSE NORMAL...
Sat Jun 20 08:32:04 2009
Errors in file /oracle/PRD/920_64/rdbms/log/prd_ora_8565.trc:
ORA-00600: internal error code, arguments: [1236], [], [], [], [], [], [], []
Sat Jun 20 08:32:59 2009
Errors in file /oracle/PRD/920_64/rdbms/log/prd_ora_8565.trc:
ORA-00600: internal error code, arguments: [1236], [], [], [], [], [], [], []
Sat Jun 20 08:33:06 2009
Errors in file /oracle/PRD/920_64/rdbms/log/prd_ora_8565.trc:
ORA-00600: internal error code, arguments: [1236], [], [], [], [], [], [], []
Sat Jun 20 08:35:17 2009
Starting ORACLE instance (normal)
Starting ORACLE instance (normal)
Sat Jun 20 09:06:57 2009
Starting ORACLE instance (normal)
 Disable cache advisory with old cache parameters
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
SCN scheme 3
LICENSE_MAX_USERS = 0
SYS auditing is disabled
Starting up ORACLE RDBMS Version: 9.2.0.4.0.
System parameters with non-default values:
  processes                = 80
  sessions                 = 96
  timed_statistics         = TRUE
  shared_pool_size         = 385875968
  shared_pool_reserved_size= 38456524
  enqueue_resources        = 8000
  control_files            = /oracle/PRD/origlogA/cntrl/cntrlPRD.dbf, /oracle/PRD/saparch/cntrl/cnt
PRD.dbf, /oracle/PRD/sapdata1/cntrl/cntrlPRD.dbf
  db_block_buffers         = 46944
  db_block_checksum        = FALSE
  db_block_size            = 8192
  compatible               = 9.2.0
  log_archive_start        = FALSE
  log_archive_dest         = /oracle/PRD/oraarch/PRDarch
  standby_archive_dest     = /oracle/PRD/oraarch/PRDarch
  log_buffer               = 1048576
  log_checkpoint_interval  = 0
  db_files                 = 254
  db_file_multiblock_read_count= 8
  log_checkpoints_to_alert = TRUE
  control_file_record_keep_time= 30
  dml_locks                = 2500
  transactions_per_rollback_segment= 20
  max_rollback_segments    = 400
  rollback_segments        = PRS_0, PRS_1, PRS_10, PRS_11, PRS_12, PRS_13, PRS_14, PRS_15, PRS_16,
S_17, PRS_18, PRS_19, PRS_2, PRS_3, PRS_4, PRS_5, PRS_6, PRS_7, PRS_8, PRS_9
  transaction_auditing     = FALSE
  remote_os_authent        = TRUE
  hash_join_enabled        = FALSE
  background_dump_dest     = /oracle/PRD/saptrace/background
  user_dump_dest           = /oracle/PRD/saptrace/usertrace
  core_dump_dest           = /oracle/PRD/saptrace/background
  optimizer_features_enable= 9.2.0
  sort_area_size           = 2097152
  sort_area_retained_size  = 0
  db_name                  = PRD
  open_cursors             = 800
  optimizer_mode           = choose
  _b_tree_bitmap_plans     = FALSE
  _push_join_predicate     = FALSE
  optimizer_index_cost_adj = 10
  _optim_peek_user_binds   = FALSE
PMON started with pid=2
DBW0 started with pid=3
LGWR started with pid=4
CKPT started with pid=5
SMON started with pid=6
RECO started with pid=7
Sat Jun 20 09:06:58 2009
ALTER DATABASE   MOUNT
Sat Jun 20 09:07:03 2009
Successful mount of redo thread 1, with mount id 1753680178.
Sat Jun 20 09:07:03 2009
Database mounted in Exclusive Mode.
Completed: ALTER DATABASE   MOUNT
Sat Jun 20 09:07:03 2009
ALTER DATABASE OPEN
Sat Jun 20 09:07:04 2009
Beginning crash recovery of 1 threads
Sat Jun 20 09:07:04 2009
Started first pass scan
Sat Jun 20 09:07:04 2009
Completed first pass scan
 0 redo blocks read, 0 data blocks need recovery
Sat Jun 20 09:07:04 2009
Started recovery at
 Thread 1: logseq 32018, block 51199, scn 0.1631468952
Recovery of Online Redo Log: Thread 1 Group 2 Seq 32018 Reading mem 0
  Mem# 0 errs 0: /oracle/PRD/origlogB/log_g12m1.dbf
  Mem# 1 errs 0: /oracle/PRD/mirrlogB/log_g12m2.dbf
Sat Jun 20 09:07:04 2009
Completed redo application
Sat Jun 20 09:07:04 2009
Ended recovery at
 Thread 1: logseq 32018, block 51199, scn 0.1631488953
 0 data blocks read, 0 data blocks written, 0 redo blocks read
Crash recovery completed successfully
Sat Jun 20 09:07:04 2009
LGWR: Primary database is in CLUSTER CONSISTENT mode
Sat Jun 20 09:07:04 2009
ARCH: Evaluating archive   log 4 thread 1 sequence 32015
ARCH: Beginning to archive log 4 thread 1 sequence 32015
Creating archive destination LOG_ARCHIVE_DEST_1: '/oracle/PRD/oraarch/PRDarch1_32015.dbf'
ARCH: Completed archiving  log 4 thread 1 sequence 32015
Sat Jun 20 09:07:05 2009
LGWR: Primary database is in CLUSTER CONSISTENT mode
Thread 1 advanced to log sequence 32019
Thread 1 opened at log sequence 32019
  Current log# 4 seq# 32019 mem# 0: /oracle/PRD/origlogB/log_g14m1.dbf
  Current log# 4 seq# 32019 mem# 1: /oracle/PRD/mirrlogB/log_g14m2.dbf
Successful open of redo thread 1.
Sat Jun 20 09:07:05 2009
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Sat Jun 20 09:07:05 2009
SMON: enabling cache recovery
SMON: enabling tx recovery
Sat Jun 20 09:07:06 2009
Database Characterset is WE8DEC
replication_dependency_tracking turned off (no async multimaster replication found)
Completed: ALTER DATABASE OPEN
Sat Jun 20 09:09:55 2009
/* BRCONNECT */ ALTER TABLESPACE "PSAPROLL" COALESCE
Sat Jun 20 09:09:55 2009
Completed: /* BRCONNECT */ ALTER TABLESPACE "PSAPROLL" COALES
Sat Jun 20 09:09:55 2009
/* BRCONNECT */ ALTER TABLESPACE "SYSTEM" COALESCE
Completed: /* BRCONNECT */ ALTER TABLESPACE "SYSTEM" COALESCE
Sat Jun 20 09:26:45 2009
ORACLE Instance PRD - Can not allocate log, archival required
Sat Jun 20 09:26:45 2009
ARCH: Connecting to console port...
Thread 1 cannot allocate new log, sequence 32020
All online logs needed archiving
  Current log# 4 seq# 32019 mem# 0: /oracle/PRD/origlogB/log_g14m1.dbf
  Current log# 4 seq# 32019 mem# 1: /oracle/PRD/mirrlogB/log_g14m2.dbf

Ankit

Former Member
0 Kudos

From alert_SID.log, i found the error that it is not creating the redo log number as in above .

Thread 1 cannot allocate new log, sequence 32020

Plz let me know what i have to do after restoration in control file.

Ankit

Former Member
0 Kudos

Ankit,

First Check Space OS (For Archived file)as well as Tablespace becuase tablespace also SYSTEM" COALESCE ..

SMON: enabling tx recovery .

Archive stuck..

SurendraJain

Former Member
0 Kudos

Dear surendra,

Free space is Ok on FS.

Archive is also not stuck.

But what i have to do with tablespace SYSTEM COALESCE as i don't have any idea abt COALESCE.

Ankit

Former Member
0 Kudos

Thanks to all of you.

My problem has been resolved. Problem was with the parameter LOG_ARCHIVE_START. it was false. i have set it to true & problem is resolved.

Ankit

Former Member
0 Kudos

Required Some more clue ..OS??

any log alertsid.log,dev,work log etc

Former Member
0 Kudos

Sorry to provide insufficient data.

My OS id HP-UX 11.23

Oracle - 9.2.0.4.0

SAP r/3 enterprise 4.7

Also i am sending the logs in trans.log file after R3trans -d command which is also getting hanged.

4 ETW000 R3trans version 6.13 (release 640 - 07.01.08 - 14:25:00).
4 ETW000 ===============================================
4 ETW000 
4 ETW000 date&time   : 20.06.2009 - 09:35:52
4 ETW000 control file: <no ctrlfile>
4 ETW000 R3trans was called as follows: R3trans -d
4 ETW000  trace at level 2 opened for a given file pointer
4 ETW000  [dev trc     ,00000]  Sat Jun 20 09:35:52 2009                             338  0.000338
4 ETW000  [dev trc     ,00000]  db_con_init called                                    33  0.000371
4 ETW000  [dev trc     ,00000]  create_con (con_name=R/3)                             72  0.000443
4 ETW000  [dev trc     ,00000]  Loading DB library '/usr/sap/PRD/SYS/exe/run/dboraslib.so' ...
4 ETW000                                                                              63  0.000506
4 ETW000  [dev trc     ,00000]  load shared library (/usr/sap/PRD/SYS/exe/run/dboraslib.so), hdl 0
4 ETW000                                                                           32813  0.033319
4 ETW000  [dev trc     ,00000]  Library '/usr/sap/PRD/SYS/exe/run/dboraslib.so' loaded
4 ETW000                                                                              28  0.033347
4 ETW000  [dev trc     ,00000]  function DbSlExpFuns loaded from library /usr/sap/PRD/SYS/exe/run/dboraslib.so
4 ETW000                                                                              56  0.033403
4 ETW000  [dev trc     ,00000]  Version of '/usr/sap/PRD/SYS/exe/run/dboraslib.so' is "640.00", patchlevel (0.220)
4 ETW000                                                                             103  0.033506
4 ETW000  [dev trc     ,00000]  function dsql_db_init loaded from library /usr/sap/PRD/SYS/exe/run/dboraslib.so
4 ETW000                                                                              31  0.033537
4 ETW000  [dev trc     ,00000]  function dbdd_exp_funs loaded from library /usr/sap/PRD/SYS/exe/run/dboraslib.so
4 ETW000                                                                              66  0.033603
4 ETW000  [dev trc     ,00000]  New connection 0 created                              43  0.033646
4 ETW000  [dev trc     ,00000]  0: name = R/3, con_id = -000000001 state = DISCONNECTED, perm = YES, reco = NO , timeout = 000, con_max = 255, con_opt = 255, occ = NO 
4 ETW000                                                                              67  0.033713
4 ETW000  [dev trc     ,00000]  db_con_connect (con_name=R/3)                         49  0.033762
4 ETW000  [dev trc     ,00000]  find_con_by_name found the following connection for reuse:
4 ETW000                                                                              23  0.033785
4 ETW000  [dev trc     ,00000]  0: name = R/3, con_id = 000000000 state = DISCONNECTED, perm = YES, reco = NO , timeout = 000, con_max = 255, con_opt = 255, occ = NO 
4 ETW000                                                                              24  0.033809
4 ETW000  [dev trc     ,00000]  Got ORACLE_HOME=/oracle/PRD/920_64 from environment
4 ETW000                                                                             334  0.034143
4 ETW000  [dev trc     ,00000]  -->oci_initialize (con_hdl=0)                         23  0.034166
4 ETW000  [dev trc     ,00000]  got NLS_LANG='AMERICAN_AMERICA.WE8DEC' from environment
4 ETW000                                                                              23  0.034189
4 ETW000  [dev trc     ,00000]  Client NLS settings: AMERICAN_AMERICA.WE8DEC        2313  0.036502
4 ETW000  [dev trc     ,00000]  Logon as OPS$-user to get SAPPRD's password           24  0.036526
4 ETW000  [dev trc     ,00000]  Connecting as /@PRD on connection 0 (nls_hdl 0) ... (dbsl 640 070208)
4 ETW000                                                                              24  0.036550
4 ETW000  [dev trc     ,00000]  Nls CharacterSet                 NationalCharSet              C      EnvHp      ErrHp ErrHpBatch
4 ETW000                                                                              24  0.036574
4 ETW000  [dev trc     ,00000]    0 WE8DEC                                                    1 6000000000c3cf10 6000000000c45bc8 6000000000c455d8
4 ETW000                                                                              24  0.036598
4 ETW000  [dev trc     ,00000]  Allocating service context handle for con_hdl=0       39  0.036637
4 ETW000  [dev trc     ,00000]  Allocating server context handle                      20  0.036657
4 ETW000  [dev trc     ,00000]  Attaching to DB Server PRD (con_hdl=0,svchp=6000000000c45508,srvhp=6000000000c478d8)
4 ETW000                                                                              66  0.036723
4 ETW000  [dev trc     ,00000]  Assigning server context 6000000000c478d8 to service context 6000000000c45508
4 ETW000                                                                          136200  0.172923
4 ETW000  [dev trc     ,00000]  Allocating user session handle                        53  0.172976
4 ETW000  [dev trc     ,00000]  Starting user session (con_hdl=0,svchp=6000000000c45508,srvhp=6000000000c478d8,usrhp=6000000000c512b8)
4 ETW000                                                                              38  0.173014
4 ETW000  [dev trc     ,00000]  Assigning user session 6000000000c512b8 to service context 6000000000c45508
4 ETW000                                                                           26158  0.199172
[dev trc     ,00000]         ETER                                                                                
4 ETW000                                                                              24  0.209074
4 ETW000  [dev trc     ,00000]  Database NLS settings: AMERICAN_AMERICA.WE8DEC       484  0.209558
4 ETW000  [dev trc     ,00000]         SELECT UPPER(INSTANCE_NAME),HOST_NAME,VERSION,TO_CHAR(STARTUP_TIME,'MON DD, YYYY, HH24:MI:SS') FROM V$INSTANCE            
4 ETW000                                                                              60  0.209618
4 ETW000  [dev trc     ,00000]  DB instance PRD is running on MSLDR with ORACLE version 9.2.0.4.0 since JUN 20, 2009, 09:06:57
4 ETW000                                                                             477  0.210095
4 ETW000  [dev trc     ,00000]         SELECT SUBSTR(NAME,1,3), TO_CHAR(CREATED,'YYYYMMDDHHMMSS') FROM V$DATABASE                                                
4 ETW000                                                                              32  0.210127
4 ETW000  [dev trc     ,00000]  Connection 0 opened (DBSL handle 0)                  872  0.210999
4 ETW000  [dev trc     ,00000]         SELECT VERSION FROM SVERS                                                                                
4 ETW000                                                                            3907  0.214906
4 ETW000  [dev trc     ,00000]         SELECT COMPCNT FROM "DDNTT"                                                                                
4 ETW000                                                                           61362  0.276268
4 ETW000  [dev trc     ,00000]  NTAB: Structure of NTAB on DB is VERS_B            16789  0.293057
4 ETW000  [dev trc     ,00000]  NTAB: standalone processing                        16071  0.309128
4 ETW000  [dev trc     ,00000]  NTAB: read profile                                    18  0.309146
4 ETW000  [dev trc     ,00000]  NTAB: rsdb/ntab/entrycount 1000.                      14  0.309160
4 ETW000  [dev trc     ,00000]  NTAB: mem_handler: alloc for 500 elems, task 0, art 3
4 ETW000                                                                              43  0.327143
4 ETW000  [dev trc     ,00000]         SELECT TABNAME, BLOCKNR, FIELDSLG, FIELDS FROM "DDNTF" WHERE TABNAME = :A0 ORDER BY TABNAME, BLOCKNR                      
4 ETW000                                                                            1151  0.328294
4 ETW000  [twdydbacc.c ,00570]  i:0                                                28749  0.357043
ETW000  [twdydbacc.c ,00575]  db_fd_p<i>.fixed_length:10                            12  0.358371
4 ETW000  [dev trc     ,00000]         SELECT VERSION, UUID, CRTIMESTMP, ABTIMESTMP, DYTIMESTMP, FLDCNT, TABLENGTH, KEYCNT, KEYLENGTH, CLIENTPOS, TABTYPE, TABFOR
4 ETW000                                                                              77  0.358448
4 ETW000  [dev trc     ,00000]         M, REFNAME, HFLAG, BUFSTATE, BUFPARM, ALIGN, POINTERLG, UNICODELG, COMPCNT, LEAFCNT FROM "DDNTT" WHERE TABNAME = :A0      
4 ETW000                                                                              25  0.358473
4 ETW000  [twdydbacc.c ,00729]  buffer:''                                            797  0.359270
4 ETW000  [twdydbacc.c ,00734]  i:0                                                   16  0.359286
4 ETW000  [twdydbacc.c ,00735]  tw_fd_p<i>.offset:0                                   12  0.359298
4 ETW000  [twdydbacc.c ,00734]  i:1                                                   11  0.359309
4 ETW000  [twdydbacc.c ,00735]  tw_fd_p<i>.offset:4                                   11  0.359320
4 ETW000  [twdydbacc.c ,00734]  i:2                                                   11  0.359331
4 ETW000  [twdydbacc.c ,00735]  tw_fd_p<i>.offset:8                                   11  0.359342
4 ETW000  [dev trc     ,00000]  { db_rtab( fcode = 'RT_READ_ONLY', tname = 'TADIR' ) {twdbcall.c:634}
4 ETW000                                                                            2886  0.362228
4 ETW000  [dev trc     ,00000]         SELECT * FROM "TADIR" WHERE "PGMID" = :A0 AND "OBJECT" = :A1 AND "OBJ_NAME" = :A2                                         
4 ETW000                                                                           15736  0.377964
4 ETW000  [dev trc     ,00000]  } db_rtab( fcode = 'RT_READ_ONLY', retcode = 0 )
4 ETW000                                                                           16182  0.394146
4 ETW000 Connected to DBMS = ORACLE --- dbs_ora_tnsname = 'PRD' --- SYSTEM = 'PRD'.
4 ETW000  [dev trc     ,00000]  { db_rtab( fcode = 'RT_INSERT', tname = 'PATCHHIST' ) {saprel.c:1276}
4 ETW000                                                                           18186  0.412332
4 ETW000  [dev trc     ,00000]         INSERT INTO "PATCHHIST" VALUES( :A0 , :A1 , :A2 , :A3 , :A4 , :A5 , :A6 , :A7 )                                           
4 ETW000                                                                           19811  0.432143
4 ETW000  [dev trc     ,00000]  Sat Jun 20 09:36:49 2009                         56679774  57.111917
4 ETW000  [dbsloci.    ,00000]  *** ERROR => Error 1013 in stmt_execute() from oci_execute_stmt(), orpc=0
4 ETW000                                                                              67  57.111984
4 ETW000  [dbsloci.    ,00000]  *** ERROR => ORA-1013 occurred when executing SQL statement (parse error offset=0)
4 ETW000                                                                              26  57.112010
4 ETW000  [dev trc     ,00000]  sc_p=6000000000bec0d8,no=5,idc_p=6000000000c02f30,con=0,act=1,slen=79,smax=256,#vars=8,stmt=6000000000d393c0,table=PATCHHIST                     
4 ETW000                                                                              35  57.112045
4 ETW000  [dev trc     ,00000]  INSERT INTO "PATCHHIST" VALUES( :A0 , :A1 , :A2 , :A3 , :A4 , :A5 , :A6 , :A7 );
4 ETW000                                                                              21  57.112066
4 ETW000  [dev trc     ,00000]     set_ocica() -> OCI or SQL return code 1013         16  57.112082
4 ETW000  [dev trc     ,00000]  sc_p=6000000000bec0d8,no=5,idc_p=6000000000c02f30,con=0,act=1,slen=79,smax=256,#vars=8,stmt=6000000000d393c0,table=PATCHHIST                     
4 ETW000                                                                              29  57.112111
4 ETW000  [dev trc     ,00000]  prep=0,lit=0,nsql=0,lobret=0,#exec=1,dbcnt=0,upsh_p=0000000000000000,ocistmth_p=6000000000ebefe0
4 ETW000                                                                              23  57.112134
4 ETW000  [dev trc     ,00000]  IN : cols=8,rmax=1,xcnt=1,rpc=0,rowi=0,rtot=1,upto=4294967295,rsize=99,vmax=32,bound=1,iobuf_p=6000000000be57d0,vda_p=6000000000ec0a90
4 ETW000                                                                              24  57.112158
4 ETW000  [dev trc     ,00000]       lobs=0,lmax=0,lpcnt=0,larr=0000000000000000,lcurr_p=0000000000000000,rret=0
4 ETW000                                                                              21  57.112179
4 ETW000  [dev trc     ,00000]  OUT: cols=0,rmax=0,xcnt=0,rpc=0,rowi=0,rtot=0,upto=0,rsize=0,vmax=0,bound=0,iobuf_p=0000000000000000,vda_p=0000000000000000
4 ETW000                                                                              23  57.112202
4 ETW000  [dev trc     ,00000]       lobs=0,lmax=0,lpcnt=0,larr=0000000000000000,lcurr_p=0000000000000000,rret=0
4 ETW000                                                                              21  57.112223
4 ETW000  [dev trc     ,00000]  INSERT INTO "PATCHHIST" VALUES( :A0 , :A1 , :A2 , :A3 , :A4 , :A5 , :A6 , :A7 );
4 ETW000                                                                              21  57.112244
4 ETW000  [dbtrtab     ,03982]  ***LOG BY4=>sql error 1013   performing INS on table PATCHHIST  [dbtrtab#4 @ 3982]
4 ETW000                                                                           16509  57.128753

Ankit