cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Error retrieving file system information for path "/tmp/.hdb_<SID>_00_lock": 61 (No data available)

Go to solution
tamil_arasan
Active Contributor

on ‎10-03-2015 5:59 PM

0 Kudos

Dear Experts,

We have issues in HANA DB. unable to start the DB due to the below issue.

FAIL: process hdbdaemon HDB Daemon not running

When I checked the trace file daemon_<host_name>.30000.003.trc, I observed the error "Error retrieving file system information for path "/tmp/.hdb_<SID>_00_lock": 61 (No data available)"

Attached trace file has detailed error. Could you please anyone help me to sort out this error..Thanks in advance..

<host_name>:/usr/sap/<SID>/HDB00/<host_name>/trace> tail -500 daemon_<host_name>.30000.003.trc

2: 0x00007fa8be4cee14 in FileAccess::FileSystem::init(char const*)+0x1210 at FileSystem.cpp:110 (libhdbbasis.so)

3: 0x00007fa8bfad7b7e in TrexIpc::NameserverLock::create()+0x5a at TrexIpc.cpp:681 (libhdbbasement.so)

4: 0x00007fa8c0b44119 in initNameserverShm()+0x355 at TrexDaemon.cpp:6196 (hdbdaemon)

5: 0x00007fa8c0b451d9 in daemonize(int, char**)+0x735 at TrexDaemon.cpp:7253 (hdbdaemon)

6: 0x00007fa8c0b86fd0 in main+0x5a0 at TrexDaemon.cpp:15306 (hdbdaemon)

7: 0x00007fa8be6a37e3 in System::mainWrapper(int, char**, char**)+0x30 at IsInMain.cpp:236 (libhdbbasis.so)

8: 0x00007fa8bb60cc36 in __libc_start_main+0xe2 (libc.so.6)

9: 0x00007fa8c0b23a29 in <no symbol>+0x0 (hdbdaemon)

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405325 e FileIO           FileSystem.cpp(00111) : <<< Begin replay FileAccess::getFileSystem call

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405331 D FileIO           SimpleFileExt.cpp(00138) : FileAccess::getFileSystem(/tmp/.hdb_<SID>_00_lock)

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405340 D FileIO           SimpleFileExt.cpp(00142) : -stat(/tmp/.hdb_<SID>_00_lock).st_dev= 27

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405381 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /, mnt_type= rootfs, st_dev= 22}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405388 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /dev, mnt_type= tmpfs, st_dev= 15}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405393 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /dev/shm, mnt_type= tmpfs, st_dev= 16}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405396 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /, mnt_type= btrfs, st_dev= 22}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405402 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /proc, mnt_type= proc, st_dev= 3}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405406 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /sys, mnt_type= sysfs, st_dev= 25}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405410 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /dev/pts, mnt_type= devpts, st_dev= 11}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405415 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /sys/kernel/debug, mnt_type= debugfs, st_dev= 6}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405429 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /sys/firmware/efi/efivars, mnt_type= efivarfs, st_dev= 26}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405433 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /boot, mnt_type= ext3, st_dev= 2051}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405438 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /boot/efi, mnt_type= vfat, st_dev= 2050}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405442 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /hana/log, mnt_type= xfs, st_dev= 2064}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405446 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /hana/data, mnt_type= xfs, st_dev= 64768}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405450 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /hana/shared, mnt_type= ext3, st_dev= 64769}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405460 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /hana/hana-backup, mnt_type= ext3, st_dev= 64770}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405465 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /hana/osbackup, mnt_type= btrfs, st_dev= 28}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405470 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /sys/fs/fuse/connections, mnt_type= fusectl, st_dev= 29}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405476 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /proc/sys/fs/binfmt_misc, mnt_type= binfmt_misc, st_dev= 36}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405482 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /var/lib/ntp/proc, mnt_type= proc, st_dev= 3}

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405493 D FileIO           SimpleFileExt.cpp(00179) : getFileSystem(/tmp/.hdb_<SID>_00_lock)= <ENTRY NOT FOUND>

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.405497 e FileIO           FileSystem.cpp(00117) : >>> End replay FileAccess::getFileSystem call

[50306]{-1}[-1/-1] 2015-10-03 19:48:26.883542 i Daemon           TrexDaemon.cpp(06216) : created nameserver shared memory (shm: shmid=6684674, size=268368856, lock: file=/tmp/.hdb_<SID>_00_lock)

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.138808 i Daemon           TrexDaemon.cpp(06219) : tested nameserver shared memory lock (979627 locks per second)

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.139086 i Daemon           TrexDaemon.cpp(11973) : reading started programs file /usr/sap/<SID>/HDB00/<host_name>/lock/started_programs.txt:

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.139112 i Daemon           TrexDaemon.cpp(12012) : started program with pid 0 is not valid

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.139187 i Daemon           TrexDaemon.cpp(12279) : opened shared memory with returncode 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.139231 i Daemon           TrexDaemon.cpp(13179) : reconfiguring all services

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.139248 i Daemon           TrexDaemon.cpp(13740) : comment file contains:

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147472 i Daemon           TrexDaemon.cpp(06968) : current umask is 0022

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147502 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of core file size (core) is 0/unlimited

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147515 i Daemon           TrexDaemon.cpp(06876) : soft limit of core file size (core) set to 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147521 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of cpu time (cpu) is unlimited/unlimited

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147528 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of data seg size (data) is unlimited/unlimited

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147533 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of file size (fsize) is unlimited/unlimited

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147539 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of max locked memory (memlock) is 65536/65536

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147545 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of open files (nofile) is 1048576/1048576

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147554 i Daemon           TrexDaemon.cpp(06876) : soft limit of open files (nofile) set to 1048576

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147560 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of max user processes (nproc) is 8272249/8272249

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147566 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of resident set size (rss) is unlimited/unlimited

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147572 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of stack size (stack) is 8388608/unlimited

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.147578 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of virtual memory (as) is unlimited/unlimited

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.152998 i Network          TrexDaemon.cpp(02726) : interfaces:

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153003 i Network          TrexDaemon.cpp(02726) : lo 127.0.0.1 ipv4 up loopback running

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153006 i Network          TrexDaemon.cpp(02726) : lo 127.0.0.2 ipv4 up loopback running

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153007 i Network          TrexDaemon.cpp(02726) : bond2 <IP> ipv4 up broadcast running multicast

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153009 i Network          TrexDaemon.cpp(02726) : bond4 172.18.15.97 ipv4 up broadcast running multicast

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153011 i Network          TrexDaemon.cpp(02726) : bond6 192.168.176.2 ipv4 up broadcast running multicast

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153187 i Network          TrexDaemon.cpp(02737) : routing table:

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153190 i Network          TrexDaemon.cpp(02737) : bond2 0.0.0.0 172.20.1.1 0.0.0.0/0 0 ipv4 up default

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153193 i Network          TrexDaemon.cpp(02737) : lo 127.0.0.0 0.0.0.0 255.0.0.0/8 0 ipv4 up

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153196 i Network          TrexDaemon.cpp(02737) : bond4 172.18.0.0 0.0.0.0 255.255.240.0/20 0 ipv4 up

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153198 i Network          TrexDaemon.cpp(02737) : bond2 172.20.0.0 0.0.0.0 255.255.240.0/20 0 ipv4 up

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153200 i Network          TrexDaemon.cpp(02737) : bond6 192.168.176.0 0.0.0.0 255.255.255.0/24 0 ipv4 up

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.153861 i Network          TrexDaemon.cpp(02751) : "localhost" resolves to 127.0.0.1

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157419 i Network          TrexDaemon.cpp(02763) : default IPv4 interface: bond2 <IP> ipv4 up broadcast running multicast

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157641 i Network          TrexDaemon.cpp(02489) : listening on 127.0.0.1:30000 with socket 7

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157665 i Network          TrexDaemon.cpp(02489) : listening on 127.0.0.2:30000 with socket 8

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157677 w Environment      Environment.cpp(00383) : Changing environment set TREXDAEMON_PORT=30000

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157705 i Daemon           TrexDaemon.cpp(12702) : handling programs nameserver,preprocessor,webdispatcher,compileserver,indexserver.OEP with target runlevel 5

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157795 i Daemon           TrexDaemon.cpp(12754) : effective program parameters of <nameserver>

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157798 i Daemon           TrexDaemon.cpp(12754) : name = HDB Nameserver

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157800 i Daemon           TrexDaemon.cpp(12754) : executable = hdbnameserver

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157801 i Daemon           TrexDaemon.cpp(12754) : arguments =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157803 i Daemon           TrexDaemon.cpp(12754) : startdir = /usr/sap/<SID>/HDB00/<host_name>

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157804 i Daemon           TrexDaemon.cpp(12754) : environment =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157808 i Daemon           TrexDaemon.cpp(12754) : priority = normal

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157810 i Daemon           TrexDaemon.cpp(12754) : affinity =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157815 i Daemon           TrexDaemon.cpp(12754) : crashtime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157817 i Daemon           TrexDaemon.cpp(12754) : starttime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157818 i Daemon           TrexDaemon.cpp(12754) : instancestarttime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157820 i Daemon           TrexDaemon.cpp(12754) : gracetime = 1000

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157822 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_retries = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157824 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_delay = 10000

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157825 i Daemon           TrexDaemon.cpp(12754) : stdout = /usr/sap/<SID>/HDB00/<host_name>/trace/nameserver.out

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157827 i Daemon           TrexDaemon.cpp(12754) : stderr =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157828 i Daemon           TrexDaemon.cpp(12754) : maxstdfiles = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157830 i Daemon           TrexDaemon.cpp(12754) : runlevel = 1

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157832 i Daemon           TrexDaemon.cpp(12754) : flags = compressbackup

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157834 i Daemon           TrexDaemon.cpp(12754) : window =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157885 i Daemon           TrexDaemon.cpp(12754) : effective program parameters of <preprocessor>

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157887 i Daemon           TrexDaemon.cpp(12754) : name = HDB Preprocessor

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157888 i Daemon           TrexDaemon.cpp(12754) : executable = hdbpreprocessor

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157890 i Daemon           TrexDaemon.cpp(12754) : arguments =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157891 i Daemon           TrexDaemon.cpp(12754) : startdir = /usr/sap/<SID>/HDB00/<host_name>

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157893 i Daemon           TrexDaemon.cpp(12754) : environment =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157894 i Daemon           TrexDaemon.cpp(12754) : priority = normal

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157896 i Daemon           TrexDaemon.cpp(12754) : affinity =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157898 i Daemon           TrexDaemon.cpp(12754) : crashtime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157899 i Daemon           TrexDaemon.cpp(12754) : starttime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157901 i Daemon           TrexDaemon.cpp(12754) : instancestarttime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157903 i Daemon           TrexDaemon.cpp(12754) : gracetime = 1000

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157904 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_retries = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157906 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_delay = 10000

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157907 i Daemon           TrexDaemon.cpp(12754) : stdout = /usr/sap/<SID>/HDB00/<host_name>/trace/preprocessor1.out

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157909 i Daemon           TrexDaemon.cpp(12754) : stderr =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157910 i Daemon           TrexDaemon.cpp(12754) : maxstdfiles = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157912 i Daemon           TrexDaemon.cpp(12754) : runlevel = 2

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157913 i Daemon           TrexDaemon.cpp(12754) : flags = compressbackup

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157915 i Daemon           TrexDaemon.cpp(12754) : window =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157964 i Daemon           TrexDaemon.cpp(12754) : effective program parameters of <webdispatcher>

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157966 i Daemon           TrexDaemon.cpp(12754) : name = HDB Web Dispatcher

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157968 i Daemon           TrexDaemon.cpp(12754) : executable = hdbwebdispatcher

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157972 i Daemon           TrexDaemon.cpp(12754) : arguments =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157973 i Daemon           TrexDaemon.cpp(12754) : startdir = /usr/sap/<SID>/HDB00/<host_name>

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157975 i Daemon           TrexDaemon.cpp(12754) : environment =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157976 i Daemon           TrexDaemon.cpp(12754) : priority = normal

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157978 i Daemon           TrexDaemon.cpp(12754) : affinity =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157980 i Daemon           TrexDaemon.cpp(12754) : crashtime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157981 i Daemon           TrexDaemon.cpp(12754) : starttime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157983 i Daemon           TrexDaemon.cpp(12754) : instancestarttime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157984 i Daemon           TrexDaemon.cpp(12754) : gracetime = 1000

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157986 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_retries = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157988 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_delay = 10000

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157989 i Daemon           TrexDaemon.cpp(12754) : stdout = /usr/sap/<SID>/HDB00/<host_name>/trace/webdispatcher.out

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157991 i Daemon           TrexDaemon.cpp(12754) : stderr =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157992 i Daemon           TrexDaemon.cpp(12754) : maxstdfiles = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157994 i Daemon           TrexDaemon.cpp(12754) : runlevel = 4

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157995 i Daemon           TrexDaemon.cpp(12754) : flags = compressbackup

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.157997 i Daemon           TrexDaemon.cpp(12754) : window =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158046 i Daemon           TrexDaemon.cpp(12754) : effective program parameters of <compileserver>

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158048 i Daemon           TrexDaemon.cpp(12754) : name = HDB Compileserver

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158050 i Daemon           TrexDaemon.cpp(12754) : executable = hdbcompileserver

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158051 i Daemon           TrexDaemon.cpp(12754) : arguments =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158052 i Daemon           TrexDaemon.cpp(12754) : startdir = /usr/sap/<SID>/HDB00/<host_name>

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158054 i Daemon           TrexDaemon.cpp(12754) : environment =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158055 i Daemon           TrexDaemon.cpp(12754) : priority = normal

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158057 i Daemon           TrexDaemon.cpp(12754) : affinity =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158059 i Daemon           TrexDaemon.cpp(12754) : crashtime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158060 i Daemon           TrexDaemon.cpp(12754) : starttime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158062 i Daemon           TrexDaemon.cpp(12754) : instancestarttime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158063 i Daemon           TrexDaemon.cpp(12754) : gracetime = 1000

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158065 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_retries = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158067 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_delay = 10000

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158068 i Daemon           TrexDaemon.cpp(12754) : stdout = /usr/sap/<SID>/HDB00/<host_name>/trace/compileserver.out

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158070 i Daemon           TrexDaemon.cpp(12754) : stderr =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158071 i Daemon           TrexDaemon.cpp(12754) : maxstdfiles = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158073 i Daemon           TrexDaemon.cpp(12754) : runlevel = 2

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158074 i Daemon           TrexDaemon.cpp(12754) : flags = compressbackup

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158078 i Daemon           TrexDaemon.cpp(12754) : window =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158138 i Daemon           TrexDaemon.cpp(12754) : effective program parameters of <indexserver.OEP>

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158140 i Daemon           TrexDaemon.cpp(12754) : name = indexserver-OEP

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158142 i Daemon           TrexDaemon.cpp(12754) : executable = hdbindexserver

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158143 i Daemon           TrexDaemon.cpp(12754) : arguments = -port 300$(INSTANCE:2)

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158145 i Daemon           TrexDaemon.cpp(12754) : startdir = /usr/sap/<SID>/HDB00/<host_name>

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158146 i Daemon           TrexDaemon.cpp(12754) : environment = DBNAME=OEP

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158147 i Daemon           TrexDaemon.cpp(12754) : priority = normal

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158149 i Daemon           TrexDaemon.cpp(12754) : affinity =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158151 i Daemon           TrexDaemon.cpp(12754) : crashtime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158153 i Daemon           TrexDaemon.cpp(12754) : starttime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158154 i Daemon           TrexDaemon.cpp(12754) : instancestarttime = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158156 i Daemon           TrexDaemon.cpp(12754) : gracetime = 1000

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158157 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_retries = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158159 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_delay = 10000

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158161 i Daemon           TrexDaemon.cpp(12754) : stdout = /usr/sap/<SID>/HDB00/<host_name>/trace/DB_OEP/indexserver.out

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158162 i Daemon           TrexDaemon.cpp(12754) : stderr = /usr/sap/<SID>/HDB00/<host_name>/trace/DB_OEP/indexserver.err

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158164 i Daemon           TrexDaemon.cpp(12754) : maxstdfiles = 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158165 i Daemon           TrexDaemon.cpp(12754) : runlevel = 3

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158167 i Daemon           TrexDaemon.cpp(12754) : flags = compressbackup

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158169 i Daemon           TrexDaemon.cpp(12754) : window =

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158182 i Daemon           TrexDaemon.cpp(12984) : runlevel 0 completely started

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158187 i Daemon           TrexDaemon.cpp(11181) : line up of program group nameserver to instances 0.

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.158240 i Daemon           TrexDaemon.cpp(07418) : starting program at '/usr/sap/<SID>/HDB00/exe/hdbnameserver'

[50306]{-1}[-1/-1] 2015-10-03 19:48:27.163132 i Daemon           TrexDaemon.cpp(10871) : start 'hdbnameserver' as process 50434

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.017348 i Daemon           TrexDaemon.cpp(08248) : signo 3 SIGQUIT from user errno 0 code 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.017385 i Daemon           TrexDaemon.cpp(08248) : sender pid 50434 real user id 1002 executable '/hana/shared/<SID>/exe/linuxx86_64/HDB_1.00.095.00.1429086950_2037389/hdbnameserver'

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.017429 i Daemon           TrexDaemon.cpp(13097) : got shutdown event (stop)

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.017445 i Daemon           TrexDaemon.cpp(13740) : comment file contains: nameserver: source site not reachable, aborting

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.017670 i Daemon           TrexDaemon.cpp(10896) : stop process hdbnameserver with pid 50434

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.017754 i Daemon           TrexDaemon.cpp(07985) : stopped child with pid 50434 (50434)

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.072893 i Daemon           TrexDaemon.cpp(13319) : process hdbnameserver with pid 50434 exited normally with status 1

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.072904 i Daemon           TrexDaemon.cpp(13395) : all instances in runlevel 1 stopped

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.073066 i Daemon           TrexDaemon.cpp(12063) : writing started programs file /usr/sap/<SID>/HDB00/<host_name>/lock/started_programs.txt:

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.116344 i Daemon           TrexDaemon.cpp(06253) : cleaning all

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.116367 i Daemon           TrexDaemon.cpp(08031) : found 11 segments in use with maximum id 12

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.116404 i Daemon           TrexDaemon.cpp(08055) : segment 1, key 0x00000000, id 6651905, sequence 203, owner 1002/111, size 1024, atime 2015-10-03 19:48:26, dtime 2015-10-03 19:48:26, ctime 2015-10-03 19:48:25, created by pid 49665, last changed by pid 49665, nattach 1

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.116422 i Daemon           TrexDaemon.cpp(08055) : segment 6, key 0x241059df, id 6717446, sequence 205, owner 1002/1001, size 117, atime 2015-10-03 19:48:28, dtime 2015-10-03 19:48:31, ctime 2015-10-03 19:48:28, created by pid 50434, last changed by pid 50434, nattach 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.116459 i Daemon           TrexDaemon.cpp(08055) : segment 7, key 0x00000000, id 6750215, sequence 206, owner 1002/1001, size 1028143, atime 2015-10-03 19:48:31, dtime 2015-10-03 19:48:31, ctime 2015-10-03 19:48:28, created by pid 50434, last changed by pid 50434, nattach 1 (deleted)

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.116472 i Daemon           TrexDaemon.cpp(08055) : segment 10, key 0x82bab42c, id 6782986, sequence 207, owner 1002/1001, size 108, atime 2015-10-03 19:48:28, dtime 2015-10-03 19:48:31, ctime 2015-10-03 19:48:28, created by pid 50434, last changed by pid 50434, nattach 0

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.116512 i Daemon           TrexDaemon.cpp(15324) : exit hdbdaemon

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.116524 i Daemon           TrexDaemon.cpp(15335) : Success: /sapmnt/ld7337/a/HDB/jenkins_prod/workspace/FA_CO_LIN64GCC47_rel_fa~newdb100_rel/sys/src/TrexDaemon/TrexDaemon.cpp:15335 in "int main(int, char**)". Leaving the "main"

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.116602 i Network          TrexDaemon.cpp(02628) : closing listen socket 7 bound to 127.0.0.1

[50306]{-1}[-1/-1] 2015-10-03 19:48:31.116623 i Network          TrexDaemon.cpp(02628) : closing listen socket 8 bound to 127.0.0.2

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.151945 i Basis            ProcessorInfo.cpp(00713) : Using GDT segment limit to determine current CPU ID

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.151964 i Basis            Timer.cpp(00650) : Using RDTSC for HR timer

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.151966 e Configuration ConfigStoreManager.cpp(00693) : Configuration directory does not exist.

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.151967 i Memory           AllocatorImpl.cpp(01356) : Allocators not used

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.151969 e Configuration ConfigStoreManager.cpp(00693) : Configuration directory does not exist.

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.151970 i Basis            ExternalCommandHandler.cpp(01462) : External Command Listener is disabled.

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.151972 w Environment      Environment.cpp(00383) : Changing environment set HDBDAEMONPID=117748

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.151903 i Basis            TraceStream.cpp(00467) : ==== Starting hdb.sap<SID>_HDB00, version 1.00.095.00.1429086950 (fa/newdb100_rel), build linuxx86_64 9a90dc475042e305cd4edc5c078f34b708ffce42 2015-04-15 10:44:35 ld7337.wdf.sap.corp gcc (SAP release 20140516, based on SUSE gcc47-4.7.2_20130108-0.15.45) 4.7.2 20130108 [gcc-4_7-branch revision 195014]

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.151975 i Basis            TraceStream.cpp(00469) : MaxOpenFiles: 1048576

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.151983 i Basis            TraceStream.cpp(00472) : Server Mode: L2 Delta

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.154342 w TraceTopic       TraceTopic.cpp(00147) : Specified trace level None for trace topic ChildOutput turns off all traces

This causes your database to be unsupportable.

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.154526 i Daemon           TrexDaemon.cpp(14486) : * hdbdaemon using config file /usr/sap/<SID>/HDB00/<host_name>/daemon.ini

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.175080 w Environment      Environment.cpp(00383) : Changing environment set DIR_INSTANCE=/usr/sap/<SID>/HDB00

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.175125 w Environment      Environment.cpp(00383) : Changing environment set DIR_EXECUTABLE=/usr/sap/<SID>/HDB00/exe

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.175141 w Environment      Environment.cpp(00383) : Changing environment set SAP_RETRIEVAL_PATH=/usr/sap/<SID>/HDB00/<host_name>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.175325 w Environment      Environment.cpp(00383) : Changing environment set PATH=/usr/sap/<SID>/HDB00/<host_name>:/usr/sap/<SID>/HDB00:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe/Python/bin:/usr/sap/<SID>/HDB00/exe/dat_bin_dir:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/<host_name>:/usr/sap/<SID>/HDB00:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe/Python/bin:/usr/sap/<SID>/HDB00/exe/dat_bin_dir:/usr/sap/<SID>/home:/usr/sap/<SID>/home/bin:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/X11R6/bin:/usr/games:/usr/lib64/jvm/jre/bin:/usr/lib/mit/bin:/usr/lib/mit/sbin:.:/opt/cmcluster/bin

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.175564 w Environment      Environment.cpp(00383) : Changing environment set LD_LIBRARY_PATH=/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe/Python/lib:/usr/sap/<SID>/HDB00/exe/filter:/usr/sap/<SID>/HDB00/exe/dat_bin_dir:/usr/sap/<SID>/HDB00/exe/plugins/afl:/usr/sap/<SID>/HDB00/exe/plugins/lcapps:/usr/sap/<SID>/HDB00/exe/plugins/repository:/usr/sap/<SID>/SYS/global/hdb/federation:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe/Python/lib:/usr/sap/<SID>/HDB00/exe/filter:/usr/sap/<SID>/HDB00/exe/dat_bin_dir:/usr/sap/<SID>/HDB00/exe/plugins/afl:/usr/sap/<SID>/HDB00/exe/plugins/lcapps:/usr/sap/<SID>/HDB00/exe/plugins/repository:/usr/sap/<SID>/SYS/global/hdb/federation

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.175648 w Environment      Environment.cpp(00383) : Changing environment set PYTHONPATH=/usr/sap/<SID>/SYS/global/hdb/custom/python_support:/usr/sap/<SID>/HDB00/exe/python_support:/usr/sap/<SID>/HDB00/<host_name>:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe/testscripts

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.175674 w Environment      Environment.cpp(00383) : Changing environment set PYTHONHOME=/usr/sap/<SID>/HDB00/exe/Python

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.175703 w Environment      Environment.cpp(00383) : Changing environment set DAT_BIN_DIR=/usr/sap/<SID>/HDB00/exe/dat_bin_dir

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.176118 i Daemon           TrexDaemon.cpp(14544) : * running on SUSE Linux Enterprise Server 11.3 (AMD/Intel x86_64 with Linux) as <SID>adm with pid 117748

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.176286 i Daemon           TrexDaemon.cpp(14544) : * SAP-System <SID> with system id 00

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.176298 i Daemon           TrexDaemon.cpp(14544) : * Version 1.00.095.00.1429086950 (rel) branch fa/newdb100_rel compiled 2015-04-15 10:44:35 on ld7337.wdf.sap.corp

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.176301 i Daemon           TrexDaemon.cpp(14544) : * DIR_INSTANCE=/usr/sap/<SID>/HDB00/

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.176314 i Daemon           TrexDaemon.cpp(14544) : * SAP_RETRIEVAL_PATH=/usr/sap/<SID>/HDB00/<host_name>/

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.176318 i Daemon           TrexDaemon.cpp(14544) : * DIR_EXECUTABLE=/usr/sap/<SID>/HDB00/exe/

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.176320 i Daemon           TrexDaemon.cpp(14544) : * data path /usr/sap/<SID>/SYS/global/hdb/data/

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.176327 i Daemon           TrexDaemon.cpp(14544) : * strict security settings

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177012 i Daemon           TrexDaemon.cpp(14599) : process environment:

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177015 i Daemon           TrexDaemon.cpp(14599) : - LESSKEY=/etc/lesskey.bin

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177024 i Daemon           TrexDaemon.cpp(14599) : - NNTPSERVER=news

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177041 i Daemon           TrexDaemon.cpp(14599) : - INFODIR=/usr/local/info:/usr/share/info:/usr/info

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177044 i Daemon           TrexDaemon.cpp(14599) : - MANPATH=/usr/local/man:/usr/share/man:/opt/cmcluster/doc/man:/usr/man

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177047 i Daemon           TrexDaemon.cpp(14599) : - HOSTNAME=<host_name>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177050 i Daemon           TrexDaemon.cpp(14599) : - XKEYSYMDB=/usr/share/X11/XKeysymDB

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177052 i Daemon           TrexDaemon.cpp(14599) : - HOST=<host_name>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177053 i Daemon           TrexDaemon.cpp(14599) : - TERM=vt100

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177055 i Daemon           TrexDaemon.cpp(14599) : - SHELL=/bin/sh

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177056 i Daemon           TrexDaemon.cpp(14599) : - PROFILEREAD=true

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177058 i Daemon           TrexDaemon.cpp(14599) : - HISTSIZE=1000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177059 i Daemon           TrexDaemon.cpp(14599) : - DIR_SYSEXE=/usr/sap/<SID>/SYS/exe/hdb

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177061 i Daemon           TrexDaemon.cpp(14599) : - MORE=-sl

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177062 i Daemon           TrexDaemon.cpp(14599) : - OLDPWD=/usr/sap/<SID>/HDB00

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177064 i Daemon           TrexDaemon.cpp(14599) : - DIR_EXECUTABLE=/usr/sap/<SID>/HDB00/exe

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177065 i Daemon           TrexDaemon.cpp(14599) : - JRE_HOME=/usr/lib64/jvm/jre

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177067 i Daemon           TrexDaemon.cpp(14599) : - USER=<SID>adm

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177068 i Daemon           TrexDaemon.cpp(14599) : - ASAN_OPTIONS=alloc_dealloc_mismatch=0:log_path=/usr/sap/<SID>/HDB00/<host_name>/trace/AddressSanitizer_Crashdump:handle_segv=0:allow_user_segv_handler=1:abort_on_error=1:check_initialization_order=1:detect_leaks=0:detect_odr_violation=1

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177074 i Daemon           TrexDaemon.cpp(14599) : - LD_LIBRARY_PATH=/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe/Python/lib:/usr/sap/<SID>/HDB00/exe/filter:/usr/sap/<SID>/HDB00/exe/dat_bin_dir:/usr/sap/<SID>/HDB00/exe/plugins/afl:/usr/sap/<SID>/HDB00/exe/plugins/lcapps:/usr/sap/<SID>/HDB00/exe/plugins/repository:/usr/sap/<SID>/SYS/global/hdb/federation:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe/Python/lib:/usr/sap/<SID>/HDB00/exe/filter:/usr/sap/<SID>/HDB00/exe/dat_bin_dir:/usr/sap/<SID>/HDB00/exe/plugins/afl:/usr/sap/<SID>/HDB00/exe/plugins/lcapps:/usr/sap/<SID>/HDB00/exe/plugins/repository:/usr/sap/<SID>/SYS/global/hdb/federation

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177077 i Daemon           TrexDaemon.cpp(14599) : - LS_COLORS=no=00:fi=00:di=01;34:ln=00;36:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=41;33;01:ex=00;32:*.cmd=00;32:*.exe=01;32:*.com=01;32:*.bat=01;32:*.btm=01;32:*.dll=01;32:*.tar=00;31:*.tbz=00;31:*.tgz=00;31:*.rpm=00;31:*.deb=00;31:*.arj=00;31:*.taz=00;31:*.lzh=00;31:*.lzma=00;31:*.zip=00;31:*.zoo=00;31:*.z=00;31:*.Z=00;31:*.gz=00;31:*.bz2=00;31:*.tb2=00;31:*.tz2=00;31:*.tbz2=00;31:*.avi=01;35:*.bmp=01;35:*.fli=01;35:*.gif=01;35:*.jpg=01;35:*.jpeg=01;35:*.mng=01;35:*.mov=01;35:*.mpg=01;35:*.pcx=01;35:*.pbm=01;35:*.pgm=01;35:*.png=01;35:*.ppm=01;35:*.tga=01;35:*.tif=01;35:*.xbm=01;35:*.xpm=01;35:*.dl=01;35:*.gl=01;35:*.wmv=01;35:*.aiff=00;32:*.au=00;32:*.mid=00;32:*.mp3=00;32:*.ogg=00;32:*.voc=00;32:*.wav=00;32:

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177079 i Daemon           TrexDaemon.cpp(14599) : - XNLSPATH=/usr/share/X11/nls

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177081 i Daemon           TrexDaemon.cpp(14599) : - ENV=/etc/bash.bashrc

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177082 i Daemon           TrexDaemon.cpp(14599) : - HOSTTYPE=x86_64

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177084 i Daemon           TrexDaemon.cpp(14599) : - FROM_HEADER=

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177085 i Daemon           TrexDaemon.cpp(14599) : - PAGER=less

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177087 i Daemon           TrexDaemon.cpp(14599) : - CSHEDIT=emacs

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177088 i Daemon           TrexDaemon.cpp(14599) : - XDG_CONFIG_DIRS=/etc/xdg

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177090 i Daemon           TrexDaemon.cpp(14599) : - MINICOM=-c on

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177091 i Daemon           TrexDaemon.cpp(14599) : - SECUDIR=/usr/sap/<SID>/HDB00/<host_name>/sec

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177093 i Daemon           TrexDaemon.cpp(14599) : - DAT_BIN_DIR=/usr/sap/<SID>/HDB00/exe/dat_bin_dir

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177095 i Daemon           TrexDaemon.cpp(14599) : - MAIL=/var/spool/mail/<SID>adm

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177096 i Daemon           TrexDaemon.cpp(14599) : - PATH=/usr/sap/<SID>/HDB00/<host_name>:/usr/sap/<SID>/HDB00:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe/Python/bin:/usr/sap/<SID>/HDB00/exe/dat_bin_dir:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/<host_name>:/usr/sap/<SID>/HDB00:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe/Python/bin:/usr/sap/<SID>/HDB00/exe/dat_bin_dir:/usr/sap/<SID>/home:/usr/sap/<SID>/home/bin:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/X11R6/bin:/usr/games:/usr/lib64/jvm/jre/bin:/usr/lib/mit/bin:/usr/lib/mit/sbin:.:/opt/cmcluster/bin

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177098 i Daemon           TrexDaemon.cpp(14599) : - ASAN_SYMBOLIZER_PATH=/sapmnt/depot/tools/gen/linuxx86_64/OpenSource/llvm/3.5/bin/llvm-symbolizer

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177100 i Daemon           TrexDaemon.cpp(14599) : - CPU=x86_64

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177101 i Daemon           TrexDaemon.cpp(14599) : - JAVA_BINDIR=/usr/lib64/jvm/jre/bin

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177103 i Daemon           TrexDaemon.cpp(14599) : - INPUTRC=/usr/sap/<SID>/home/.inputrc

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177106 i Daemon           TrexDaemon.cpp(14599) : - PWD=/usr/sap/<SID>/HDB00

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177108 i Daemon           TrexDaemon.cpp(14599) : - JAVA_HOME=/usr/lib64/jvm/jre

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177110 i Daemon           TrexDaemon.cpp(14599) : - LANG=en_US.UTF-8

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177111 i Daemon           TrexDaemon.cpp(14599) : - PYTHONSTARTUP=/etc/pythonstart

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177113 i Daemon           TrexDaemon.cpp(14599) : - SAPSYSTEMNAME=<SID>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177114 i Daemon           TrexDaemon.cpp(14599) : - PYTHONHOME=/usr/sap/<SID>/HDB00/exe/Python

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177116 i Daemon           TrexDaemon.cpp(14599) : - PS1=\h:\w>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177117 i Daemon           TrexDaemon.cpp(14599) : - SAP_RETRIEVAL_PATH=/usr/sap/<SID>/HDB00/<host_name>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177119 i Daemon           TrexDaemon.cpp(14599) : - QT_SYSTEM_DIR=/usr/share/desktop-data

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177121 i Daemon           TrexDaemon.cpp(14599) : - SHLVL=1

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177122 i Daemon           TrexDaemon.cpp(14599) : - HOME=/usr/sap/<SID>/home

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177124 i Daemon           TrexDaemon.cpp(14599) : - LESS_ADVANCED_PREPROCESSOR=no

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177125 i Daemon           TrexDaemon.cpp(14599) : - OSTYPE=linux

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177127 i Daemon           TrexDaemon.cpp(14599) : - LS_OPTIONS=-N --color=tty -T 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177128 i Daemon           TrexDaemon.cpp(14599) : - XCURSOR_THEME=crystalwhite

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177130 i Daemon           TrexDaemon.cpp(14599) : - DIR_INSTANCE=/usr/sap/<SID>/HDB00

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177131 i Daemon           TrexDaemon.cpp(14599) : - WINDOWMANAGER=

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177133 i Daemon           TrexDaemon.cpp(14599) : - PYTHONPATH=/usr/sap/<SID>/SYS/global/hdb/custom/python_support:/usr/sap/<SID>/HDB00/exe/python_support:/usr/sap/<SID>/HDB00/<host_name>:/usr/sap/<SID>/HDB00/exe:/usr/sap/<SID>/HDB00/exe/testscripts

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177135 i Daemon           TrexDaemon.cpp(14599) : - G_FILENAME_ENCODING=@locale,UTF-8,ISO-8859-15,CP1252

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177136 i Daemon           TrexDaemon.cpp(14599) : - LESS=-M -I

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177138 i Daemon           TrexDaemon.cpp(14599) : - MACHTYPE=x86_64-suse-linux

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177139 i Daemon           TrexDaemon.cpp(14599) : - LOGNAME=<SID>adm

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177141 i Daemon           TrexDaemon.cpp(14599) : - XDG_DATA_DIRS=/usr/share:/etc/opt/kde3/share:/opt/kde3/share

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177142 i Daemon           TrexDaemon.cpp(14599) : - OMP_NUM_THREADS=1

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177144 i Daemon           TrexDaemon.cpp(14599) : - LESSOPEN=lessopen.sh %s

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177145 i Daemon           TrexDaemon.cpp(14599) : - INFOPATH=/usr/local/info:/usr/share/info:/usr/info

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177147 i Daemon           TrexDaemon.cpp(14599) : - LESSCLOSE=lessclose.sh %s %s

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177149 i Daemon           TrexDaemon.cpp(14599) : - G_BROKEN_FILENAMES=1

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177150 i Daemon           TrexDaemon.cpp(14599) : - JAVA_ROOT=/usr/lib64/jvm/jre

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177152 i Daemon           TrexDaemon.cpp(14599) : - COLORTERM=1

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177153 i Daemon           TrexDaemon.cpp(14599) : - BASH_FUNC_mc()=() {  . /usr/share/mc/bin/mc-wrapper.sh

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177155 i Daemon           TrexDaemon.cpp(14599) : - }

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177156 i Daemon           TrexDaemon.cpp(14599) : - _=/usr/bin/env

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177160 i Daemon           TrexDaemon.cpp(14599) : - DIR_LIBRARY=/usr/sap/<SID>/HDB00/exe

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177162 i Daemon           TrexDaemon.cpp(14599) : - SHLIB_PATH=/usr/sap/<SID>/HDB00/exe:

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177163 i Daemon           TrexDaemon.cpp(14599) : - LIBPATH=/usr/sap/<SID>/HDB00/exe:

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177165 i Daemon           TrexDaemon.cpp(14599) : - NODNSSAPTRANSHOST=1

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177166 i Daemon           TrexDaemon.cpp(14599) : - SAP_DIR_GLOBAL=/usr/sap/<SID>/SYS/global

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177168 i Daemon           TrexDaemon.cpp(14599) : - HDBDAEMONPID=117748

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177936 i Daemon           TrexDaemon.cpp(14997) : all allowed paths:

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177957 i Daemon           TrexDaemon.cpp(14997) : /usr/sap/<SID>/HDB00/exe/

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177959 i Daemon           TrexDaemon.cpp(14997) : /hana/shared/<SID>/HDB00/exe/

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177960 i Daemon           TrexDaemon.cpp(14997) : /hana/shared/<SID>/exe/linuxx86_64/hdb/

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.177962 i Daemon           TrexDaemon.cpp(14997) : /hana/shared/<SID>/exe/linuxx86_64/HDB_1.00.095.00.1429086950_2037389/

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.178059 i Daemon           TrexDaemon.cpp(07006) : 0 is not a tty

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.179377 e FileIO           FileSystem.cpp(00110) : Error retrieving file system information for path "/tmp/.hdb_<SID>_00_lock": 61 (No data available)

43[thr=0]: <SYSTEM> at

1: 0x00007feb9fd73d82 in Execution::ContextFunctions::dumpInfo(Execution::Context&, ltt::basic_ostream<char, ltt::char_traits<char> >&, bool, bool, bool, bool, bool)+0x390 at ContextFunctions.cpp:681 (libhdbbasis.so)

2: 0x00007feb9fe14e14 in FileAccess::FileSystem::init(char const*)+0x1210 at FileSystem.cpp:110 (libhdbbasis.so)

3: 0x00007feba141db7e in TrexIpc::NameserverLock::create()+0x5a at TrexIpc.cpp:681 (libhdbbasement.so)

4: 0x00007feba248a119 in initNameserverShm()+0x355 at TrexDaemon.cpp:6196 (hdbdaemon)

5: 0x00007feba248b1d9 in daemonize(int, char**)+0x735 at TrexDaemon.cpp:7253 (hdbdaemon)

6: 0x00007feba24ccfd0 in main+0x5a0 at TrexDaemon.cpp:15306 (hdbdaemon)

7: 0x00007feb9ffe97e3 in System::mainWrapper(int, char**, char**)+0x30 at IsInMain.cpp:236 (libhdbbasis.so)

8: 0x00007feb9cf52c36 in __libc_start_main+0xe2 (libc.so.6)

9: 0x00007feba2469a29 in <no symbol>+0x0 (hdbdaemon)

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196830 e FileIO           FileSystem.cpp(00111) : <<< Begin replay FileAccess::getFileSystem call

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196838 D FileIO           SimpleFileExt.cpp(00138) : FileAccess::getFileSystem(/tmp/.hdb_<SID>_00_lock)

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196847 D FileIO           SimpleFileExt.cpp(00142) : -stat(/tmp/.hdb_<SID>_00_lock).st_dev= 27

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196890 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /, mnt_type= rootfs, st_dev= 22}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196897 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /dev, mnt_type= tmpfs, st_dev= 15}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196902 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /dev/shm, mnt_type= tmpfs, st_dev= 16}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196906 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /, mnt_type= btrfs, st_dev= 22}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196912 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /proc, mnt_type= proc, st_dev= 3}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196916 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /sys, mnt_type= sysfs, st_dev= 25}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196920 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /dev/pts, mnt_type= devpts, st_dev= 11}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196925 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /sys/kernel/debug, mnt_type= debugfs, st_dev= 6}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196933 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /sys/firmware/efi/efivars, mnt_type= efivarfs, st_dev= 26}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196938 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /boot, mnt_type= ext3, st_dev= 2051}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196943 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /boot/efi, mnt_type= vfat, st_dev= 2050}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196947 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /hana/log, mnt_type= xfs, st_dev= 2064}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196951 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /hana/data, mnt_type= xfs, st_dev= 64768}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196956 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /hana/shared, mnt_type= ext3, st_dev= 64769}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196967 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /hana/hana-backup, mnt_type= ext3, st_dev= 64770}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196971 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /hana/osbackup, mnt_type= btrfs, st_dev= 28}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196976 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /sys/fs/fuse/connections, mnt_type= fusectl, st_dev= 29}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196982 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /proc/sys/fs/binfmt_misc, mnt_type= binfmt_misc, st_dev= 36}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196988 D FileIO           SimpleFileExt.cpp(00156) : --pEntry={mnt_dir= /var/lib/ntp/proc, mnt_type= proc, st_dev= 3}

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.196999 D FileIO           SimpleFileExt.cpp(00179) : getFileSystem(/tmp/.hdb_<SID>_00_lock)= <ENTRY NOT FOUND>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.197003 e FileIO           FileSystem.cpp(00117) : >>> End replay FileAccess::getFileSystem call

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.670583 i Daemon           TrexDaemon.cpp(06216) : created nameserver shared memory (shm: shmid=6848514, size=268368856, lock: file=/tmp/.hdb_<SID>_00_lock)

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.926098 i Daemon           TrexDaemon.cpp(06219) : tested nameserver shared memory lock (861181 locks per second)

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.926315 i Daemon           TrexDaemon.cpp(11973) : reading started programs file /usr/sap/<SID>/HDB00/<host_name>/lock/started_programs.txt:

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.926337 i Daemon           TrexDaemon.cpp(12012) : started program with pid 0 is not valid

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.926400 i Daemon           TrexDaemon.cpp(12279) : opened shared memory with returncode 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.926445 i Daemon           TrexDaemon.cpp(13179) : reconfiguring all services

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.926462 i Daemon           TrexDaemon.cpp(13740) : comment file contains:

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934670 i Daemon           TrexDaemon.cpp(06968) : current umask is 0022

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934696 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of core file size (core) is 0/unlimited

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934709 i Daemon           TrexDaemon.cpp(06876) : soft limit of core file size (core) set to 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934716 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of cpu time (cpu) is unlimited/unlimited

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934722 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of data seg size (data) is unlimited/unlimited

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934728 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of file size (fsize) is unlimited/unlimited

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934734 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of max locked memory (memlock) is 65536/65536

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934746 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of open files (nofile) is 1048576/1048576

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934750 i Daemon           TrexDaemon.cpp(06876) : soft limit of open files (nofile) set to 1048576

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934755 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of max user processes (nproc) is 8272249/8272249

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934761 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of resident set size (rss) is unlimited/unlimited

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934767 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of stack size (stack) is 8388608/unlimited

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.934773 i Daemon           TrexDaemon.cpp(06848) : current soft/hard limit of virtual memory (as) is unlimited/unlimited

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940183 i Network          TrexDaemon.cpp(02726) : interfaces:

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940189 i Network          TrexDaemon.cpp(02726) : lo 127.0.0.1 ipv4 up loopback running

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940191 i Network          TrexDaemon.cpp(02726) : lo 127.0.0.2 ipv4 up loopback running

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940193 i Network          TrexDaemon.cpp(02726) : bond2 <IP> ipv4 up broadcast running multicast

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940195 i Network          TrexDaemon.cpp(02726) : bond4 172.18.15.97 ipv4 up broadcast running multicast

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940197 i Network          TrexDaemon.cpp(02726) : bond6 192.168.176.2 ipv4 up broadcast running multicast

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940357 i Network          TrexDaemon.cpp(02737) : routing table:

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940360 i Network          TrexDaemon.cpp(02737) : bond2 0.0.0.0 172.20.1.1 0.0.0.0/0 0 ipv4 up default

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940364 i Network          TrexDaemon.cpp(02737) : lo 127.0.0.0 0.0.0.0 255.0.0.0/8 0 ipv4 up

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940366 i Network          TrexDaemon.cpp(02737) : bond4 172.18.0.0 0.0.0.0 255.255.240.0/20 0 ipv4 up

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940369 i Network          TrexDaemon.cpp(02737) : bond2 172.20.0.0 0.0.0.0 255.255.240.0/20 0 ipv4 up

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940371 i Network          TrexDaemon.cpp(02737) : bond6 192.168.176.0 0.0.0.0 255.255.255.0/24 0 ipv4 up

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.940958 i Network          TrexDaemon.cpp(02751) : "localhost" resolves to 127.0.0.1

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946083 i Network          TrexDaemon.cpp(02763) : default IPv4 interface: bond2 <IP> ipv4 up broadcast running multicast

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946294 i Network          TrexDaemon.cpp(02489) : listening on 127.0.0.1:30000 with socket 7

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946322 i Network          TrexDaemon.cpp(02489) : listening on 127.0.0.2:30000 with socket 8

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946331 w Environment      Environment.cpp(00383) : Changing environment set TREXDAEMON_PORT=30000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946358 i Daemon           TrexDaemon.cpp(12702) : handling programs nameserver,preprocessor,webdispatcher,compileserver,indexserver.OEP with target runlevel 5

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946439 i Daemon           TrexDaemon.cpp(12754) : effective program parameters of <nameserver>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946442 i Daemon           TrexDaemon.cpp(12754) : name = HDB Nameserver

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946444 i Daemon           TrexDaemon.cpp(12754) : executable = hdbnameserver

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946445 i Daemon           TrexDaemon.cpp(12754) : arguments =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946447 i Daemon           TrexDaemon.cpp(12754) : startdir = /usr/sap/<SID>/HDB00/<host_name>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946452 i Daemon           TrexDaemon.cpp(12754) : environment =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946453 i Daemon           TrexDaemon.cpp(12754) : priority = normal

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946455 i Daemon           TrexDaemon.cpp(12754) : affinity =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946459 i Daemon           TrexDaemon.cpp(12754) : crashtime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946462 i Daemon           TrexDaemon.cpp(12754) : starttime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946464 i Daemon           TrexDaemon.cpp(12754) : instancestarttime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946465 i Daemon           TrexDaemon.cpp(12754) : gracetime = 1000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946467 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_retries = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946469 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_delay = 10000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946471 i Daemon           TrexDaemon.cpp(12754) : stdout = /usr/sap/<SID>/HDB00/<host_name>/trace/nameserver.out

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946472 i Daemon           TrexDaemon.cpp(12754) : stderr =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946474 i Daemon           TrexDaemon.cpp(12754) : maxstdfiles = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946475 i Daemon           TrexDaemon.cpp(12754) : runlevel = 1

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946477 i Daemon           TrexDaemon.cpp(12754) : flags = compressbackup

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946479 i Daemon           TrexDaemon.cpp(12754) : window =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946533 i Daemon           TrexDaemon.cpp(12754) : effective program parameters of <preprocessor>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946535 i Daemon           TrexDaemon.cpp(12754) : name = HDB Preprocessor

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946537 i Daemon           TrexDaemon.cpp(12754) : executable = hdbpreprocessor

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946538 i Daemon           TrexDaemon.cpp(12754) : arguments =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946540 i Daemon           TrexDaemon.cpp(12754) : startdir = /usr/sap/<SID>/HDB00/<host_name>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946541 i Daemon           TrexDaemon.cpp(12754) : environment =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946542 i Daemon           TrexDaemon.cpp(12754) : priority = normal

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946544 i Daemon           TrexDaemon.cpp(12754) : affinity =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946546 i Daemon           TrexDaemon.cpp(12754) : crashtime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946548 i Daemon           TrexDaemon.cpp(12754) : starttime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946550 i Daemon           TrexDaemon.cpp(12754) : instancestarttime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946551 i Daemon           TrexDaemon.cpp(12754) : gracetime = 1000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946553 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_retries = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946554 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_delay = 10000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946556 i Daemon           TrexDaemon.cpp(12754) : stdout = /usr/sap/<SID>/HDB00/<host_name>/trace/preprocessor1.out

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946557 i Daemon           TrexDaemon.cpp(12754) : stderr =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946559 i Daemon           TrexDaemon.cpp(12754) : maxstdfiles = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946561 i Daemon           TrexDaemon.cpp(12754) : runlevel = 2

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946562 i Daemon           TrexDaemon.cpp(12754) : flags = compressbackup

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946564 i Daemon           TrexDaemon.cpp(12754) : window =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946614 i Daemon           TrexDaemon.cpp(12754) : effective program parameters of <webdispatcher>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946618 i Daemon           TrexDaemon.cpp(12754) : name = HDB Web Dispatcher

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946620 i Daemon           TrexDaemon.cpp(12754) : executable = hdbwebdispatcher

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946621 i Daemon           TrexDaemon.cpp(12754) : arguments =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946623 i Daemon           TrexDaemon.cpp(12754) : startdir = /usr/sap/<SID>/HDB00/<host_name>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946624 i Daemon           TrexDaemon.cpp(12754) : environment =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946626 i Daemon           TrexDaemon.cpp(12754) : priority = normal

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946627 i Daemon           TrexDaemon.cpp(12754) : affinity =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946629 i Daemon           TrexDaemon.cpp(12754) : crashtime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946631 i Daemon           TrexDaemon.cpp(12754) : starttime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946633 i Daemon           TrexDaemon.cpp(12754) : instancestarttime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946634 i Daemon           TrexDaemon.cpp(12754) : gracetime = 1000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946636 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_retries = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946638 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_delay = 10000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946639 i Daemon           TrexDaemon.cpp(12754) : stdout = /usr/sap/<SID>/HDB00/<host_name>/trace/webdispatcher.out

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946641 i Daemon           TrexDaemon.cpp(12754) : stderr =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946642 i Daemon           TrexDaemon.cpp(12754) : maxstdfiles = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946644 i Daemon           TrexDaemon.cpp(12754) : runlevel = 4

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946645 i Daemon           TrexDaemon.cpp(12754) : flags = compressbackup

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946647 i Daemon           TrexDaemon.cpp(12754) : window =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946698 i Daemon           TrexDaemon.cpp(12754) : effective program parameters of <compileserver>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946700 i Daemon           TrexDaemon.cpp(12754) : name = HDB Compileserver

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946701 i Daemon           TrexDaemon.cpp(12754) : executable = hdbcompileserver

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946702 i Daemon           TrexDaemon.cpp(12754) : arguments =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946704 i Daemon           TrexDaemon.cpp(12754) : startdir = /usr/sap/<SID>/HDB00/<host_name>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946705 i Daemon           TrexDaemon.cpp(12754) : environment =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946707 i Daemon           TrexDaemon.cpp(12754) : priority = normal

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946708 i Daemon           TrexDaemon.cpp(12754) : affinity =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946710 i Daemon           TrexDaemon.cpp(12754) : crashtime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946712 i Daemon           TrexDaemon.cpp(12754) : starttime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946714 i Daemon           TrexDaemon.cpp(12754) : instancestarttime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946715 i Daemon           TrexDaemon.cpp(12754) : gracetime = 1000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946717 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_retries = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946718 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_delay = 10000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946720 i Daemon           TrexDaemon.cpp(12754) : stdout = /usr/sap/<SID>/HDB00/<host_name>/trace/compileserver.out

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946721 i Daemon           TrexDaemon.cpp(12754) : stderr =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946723 i Daemon           TrexDaemon.cpp(12754) : maxstdfiles = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946726 i Daemon           TrexDaemon.cpp(12754) : runlevel = 2

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946728 i Daemon           TrexDaemon.cpp(12754) : flags = compressbackup

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946729 i Daemon           TrexDaemon.cpp(12754) : window =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946787 i Daemon           TrexDaemon.cpp(12754) : effective program parameters of <indexserver.OEP>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946790 i Daemon           TrexDaemon.cpp(12754) : name = indexserver-OEP

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946791 i Daemon           TrexDaemon.cpp(12754) : executable = hdbindexserver

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946793 i Daemon           TrexDaemon.cpp(12754) : arguments = -port 300$(INSTANCE:2)

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946794 i Daemon           TrexDaemon.cpp(12754) : startdir = /usr/sap/<SID>/HDB00/<host_name>

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946796 i Daemon           TrexDaemon.cpp(12754) : environment = DBNAME=OEP

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946797 i Daemon           TrexDaemon.cpp(12754) : priority = normal

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946799 i Daemon           TrexDaemon.cpp(12754) : affinity =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946801 i Daemon           TrexDaemon.cpp(12754) : crashtime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946803 i Daemon           TrexDaemon.cpp(12754) : starttime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946804 i Daemon           TrexDaemon.cpp(12754) : instancestarttime = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946806 i Daemon           TrexDaemon.cpp(12754) : gracetime = 1000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946807 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_retries = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946809 i Daemon           TrexDaemon.cpp(12754) : startup_error_restart_delay = 10000

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946810 i Daemon           TrexDaemon.cpp(12754) : stdout = /usr/sap/<SID>/HDB00/<host_name>/trace/DB_OEP/indexserver.out

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946812 i Daemon           TrexDaemon.cpp(12754) : stderr = /usr/sap/<SID>/HDB00/<host_name>/trace/DB_OEP/indexserver.err

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946814 i Daemon           TrexDaemon.cpp(12754) : maxstdfiles = 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946815 i Daemon           TrexDaemon.cpp(12754) : runlevel = 3

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946817 i Daemon           TrexDaemon.cpp(12754) : flags = compressbackup

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946819 i Daemon           TrexDaemon.cpp(12754) : window =

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946825 i Daemon           TrexDaemon.cpp(12984) : runlevel 0 completely started

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946830 i Daemon           TrexDaemon.cpp(11181) : line up of program group nameserver to instances 0.

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.946883 i Daemon           TrexDaemon.cpp(07418) : starting program at '/usr/sap/<SID>/HDB00/exe/hdbnameserver'

[117748]{-1}[-1/-1] 2015-10-03 20:33:23.951590 i Daemon           TrexDaemon.cpp(10871) : start 'hdbnameserver' as process 117763

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.820122 i Daemon           TrexDaemon.cpp(08248) : signo 3 SIGQUIT from user errno 0 code 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.820156 i Daemon           TrexDaemon.cpp(08248) : sender pid 117763 real user id 1002 executable '/hana/shared/<SID>/exe/linuxx86_64/HDB_1.00.095.00.1429086950_2037389/hdbnameserver'

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.820198 i Daemon           TrexDaemon.cpp(13097) : got shutdown event (stop)

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.820214 i Daemon           TrexDaemon.cpp(13740) : comment file contains: nameserver: source site not reachable, aborting

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.820453 i Daemon           TrexDaemon.cpp(10896) : stop process hdbnameserver with pid 117763

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.820532 i Daemon           TrexDaemon.cpp(07985) : stopped child with pid 117763 (117763)

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.878326 i Daemon           TrexDaemon.cpp(13319) : process hdbnameserver with pid 117763 exited normally with status 1

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.878337 i Daemon           TrexDaemon.cpp(13395) : all instances in runlevel 1 stopped

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.878475 i Daemon           TrexDaemon.cpp(12063) : writing started programs file /usr/sap/<SID>/HDB00/<host_name>/lock/started_programs.txt:

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.916869 i Daemon           TrexDaemon.cpp(06253) : cleaning all

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.916893 i Daemon           TrexDaemon.cpp(08031) : found 11 segments in use with maximum id 12

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.916930 i Daemon           TrexDaemon.cpp(08055) : segment 1, key 0x00000000, id 6815745, sequence 208, owner 1002/111, size 1024, atime 2015-10-03 20:33:23, dtime 2015-10-03 20:33:23, ctime 2015-10-03 20:33:22, created by pid 117740, last changed by pid 117740, nattach 1

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.916946 i Daemon           TrexDaemon.cpp(08055) : segment 6, key 0x241059df, id 6881286, sequence 210, owner 1002/1001, size 117, atime 2015-10-03 20:33:24, dtime 2015-10-03 20:33:27, ctime 2015-10-03 20:33:25, created by pid 117763, last changed by pid 117763, nattach 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.916975 i Daemon           TrexDaemon.cpp(08055) : segment 7, key 0x00000000, id 6914055, sequence 211, owner 1002/1001, size 1028143, atime 2015-10-03 20:33:27, dtime 2015-10-03 20:33:27, ctime 2015-10-03 20:33:25, created by pid 117763, last changed by pid 117763, nattach 1 (deleted)

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.916988 i Daemon           TrexDaemon.cpp(08055) : segment 10, key 0x82bab42c, id 6946826, sequence 212, owner 1002/1001, size 108, atime 2015-10-03 20:33:25, dtime 2015-10-03 20:33:27, ctime 2015-10-03 20:33:25, created by pid 117763, last changed by pid 117763, nattach 0

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.917032 i Daemon           TrexDaemon.cpp(15324) : exit hdbdaemon

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.917042 i Daemon           TrexDaemon.cpp(15335) : Success: /sapmnt/ld7337/a/HDB/jenkins_prod/workspace/FA_CO_LIN64GCC47_rel_fa~newdb100_rel/sys/src/TrexDaemon/TrexDaemon.cpp:15335 in "int main(int, char**)". Leaving the "main"

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.917114 i Network          TrexDaemon.cpp(02628) : closing listen socket 7 bound to 127.0.0.1

[117748]{-1}[-1/-1] 2015-10-03 20:33:27.917136 i Network          TrexDaemon.cpp(02628) : closing listen socket 8 bound to 127.0.0.2<host_name>:/usr/sap/<SID>/HDB00/<host_name>/trace>

Show replies
Show replies
Answer

Accepted Solutions (1)

Accepted Solutions (1)

tamil_arasan
Active Contributor
‎10-06-2015 3:43 PM
0 Kudos

The issue has been resolved by the below steps,

Primary not started due to topology information is unable to get - Which is reported in daemon trace file ---> executed the command  hdbnsutil -initTopology

Once the above command is executed, existing topology info are cleared and topology is initialized.

Then cleared all the primary and secondary configuration and started primary . registered primary as primary and secondary as secondary. All tenant DB are up in primary .

System replication status is "ÜNKNOWN" for the one tenant DB alone. I just triggered backup for affected tenant DB. The replication started and became ACTIVE.

Now all the issues are resolved. Thanks all for your help

Thanks,

Pradeep

Show replies
Show replies
Former Member
‎10-06-2015 5:29 PM
0 Kudos

Hello Pradeep,

Sorry I couldn't get back to you. Thing called the "day job" got in the way.

Anway, well done.

Cheers,

Amerjit

Answers (1)

Answers (1)

Former Member
‎10-03-2015 7:32 PM
0 Kudos

This is the namesever topology lock file in the /tmp file system, see SAP Note 1999998 for some more information about it. It looks like something is wrong accessing this file, so you should check if /tmp is a properly mounted local file system. And you need to make sure that no software (e.g. some kind of cleanup) touches / removes this file in the /tmp file system.

Show replies
Show replies
tamil_arasan
Active Contributor
‎10-04-2015 7:04 AM
0 Kudos

Dear Martin,

The lock file is not available in the path /tmp folder however when I check the trace file, it is created but not sure whether it is getting deleted automatically. I checked the note for details about the the lock file. How to troubleshoot this issue ? any suggestion please .

Thanks a lot,

Pradeep

Former Member
‎10-04-2015 7:08 AM
0 Kudos

As I said: Check if there is any mechanism in place that cleans your /tmp file system. This has nothing to do with SAP HANA, so you should consult your operating system and infrastructure experts.

tamil_arasan
Active Contributor
‎10-04-2015 7:23 AM
0 Kudos

Dear Martin,

Thanks a lot for your suggestion. There is no mechanism to auto cleanup the /tmp directory as the HANA DB was running fine since last week. We had issues with tenant DB startup then now overall DB is not coming up.

Any other things I can check in the OS/DB level. could you please suggest.

Thanks a lot,

Pradeep

Former Member
‎10-04-2015 9:38 AM
0 Kudos

Hello Pradeep,

1. Make sure there are no processes running as <sid>adm (for a clean start)

2. Check the permissions on the /tmp directory (drwxrwxrwt)

3. Is /tmp a separate filesystem or just a directory under /

4. Obvious as it may sound, have you checked that /tmp isn't full ? (if it is a separate f/s)

5. As <sid>adm, go to /tmp and perform a touch of a file. eg: touch DELME (is the file created ?)

KR,

Amerjit

tamil_arasan
Active Contributor
‎10-04-2015 11:14 AM
0 Kudos

Hi Amerjit,

The issue was with replication and server start-up in primary server. Now actual secondary server registered as primary and  actual primary registered as secondary.

Now unable to start the HANA in old primary system.

1. Make sure there are no processes running as <sid>adm (for a clean start)

Restarted server and tried . Still same issue persisiting.

2. Check the permissions on the /tmp directory (drwxrwxrwt)

created test file using <sid>adm, able to create it

3. Is /tmp a separate filesystem or just a directory under /

It is under root directory (/)

4. Obvious as it may sound, have you checked that /tmp isn't full ? (if it is a separate f/s)

No it is not full.

5. As <sid>adm, go to /tmp and perform a touch of a file. eg: touch DELME (is the file created ?)

The file is not crated

Any suggestion please

Many Thanks,

Pradeep

Former Member
‎10-04-2015 11:33 AM
0 Kudos

Hello Pradeep,

Just to avoid anything being lost in translation.

Q) When you ran "touch DELME" as <sidadm> in /tmp, what message/error did you get ?

A)

Q) Did you try the "touch" as user "root" ?

A)

Q) Have you checked your /var/log/messages file ?

A)

As Martin already pointed out and your reply seems to confirm this, this is not a HANA problem but a o/s problem.

Find out what's not right with your /tmp with your o/s admin (worrying as /tmp is on root filesystem). They may want to run a fsck in dry run mode on "/"

Kind Regards,

Amerjit

tamil_arasan
Active Contributor
‎10-04-2015 11:48 AM
0 Kudos

Hi Amerjit,

Sorry, I have checked without executing the command "touch". I have tried now with touch command. It has created DELME file under /tmp directory.

Do I need to check anything else? I am new to HANA, could you please let me know anything we can check ?

When I tried to start nameserver from the server exe folder, I got below error,

unclean shutdown of service instance with pid 15206.

service startup...

accepting requests at 127.0.0.1:30001; 127.0.0.2:30001

searching for master nameserver <host-name>:30001 ...

assign as master nameserver. assign to volume 1 started

service startup...

checking for recovery request ...

loading topology ...

opening persistence ...

run as transaction master

Failed to retrieve HA role for current host from topology, cannot proceed with startup sequence.

Please make sure to properly add additional hosts using addHost/hdbnsutil -> stopping instance ...

cannot send signal. (2, No such file or directory)

prepare for shutting service down...

preparing to shutdown...

waiting for assign thread .....

Thanks,

Pradeep

Former Member
‎10-04-2015 1:01 PM
0 Kudos

Hello Pradeep,

If you had mentioned from the outset that your problem was due to replication it really would have helped.

So, reason aside, you find yourself running on the secondary node and I will assume that you have resolved whatever problem there was on the primary node and now you want to be running on the primary node again. Is that a fair summary ?

On both your primary and secondary sites please run the following command and post the output for each site in the thread. Also post (or upload) your nameserver.ini file.

hdbnsutil -sr_state

What steps/process did you follow so that you are running on the secondary site ?

If you provide a good summary of what happened and what steps you took up until now it really will help anyone who wants to help you.

KR,

Amerjit

tamil_arasan
Active Contributor
‎10-04-2015 2:20 PM
0 Kudos

Dear Amerjit,

Here is the problem summary : The HANA DB was running fine in primary with syn mode replication with secondary (Multi-tenant). suddenly two tenant DB was not connecting with SAP which were running in primary server. I have restarted the both the affected tenant DB by SQL command. one DB came to online and replication status came to ACTIVE, another tenant DB (for e.g; Multi-tenant DB SID : PRD) didn't come to online and status went to "UNKNOWN".

After few minutes, fail over happened to secondary server and still the PRD tenant DB status is UNKNOWN.

We have tried to failback to primary and start up all the DB, but no processes are starting. I have raised to SAP/HP. HP support team, registered actual secondary as primary and actual primary as secondary and tried to bring the DB online, still unable to start any DB in primary.

Now I want to startup HANA DB in actual primary and clear all existing replication setup then reconfigure. Could you please help on this. Thanks a lot.

<secondary_host>:/usr/sap/<SID>/HDB00> hdbnsutil -sr_state

checking for active or inactive nameserver ...

nameserver <secondary_host>:30001 not responding.

nameserver <secondary_host>:30001 not responding.

System Replication State

~~~~~~~~~~~~~~~~~~~~~~~~

mode: primary

site id: 1

site name: <SID>_secondary

done.

<primary_node>:/usr/sap/<SID>/HDB00>  hdbnsutil -sr_state

checking for active or inactive nameserver ...

nameserver <primary_host>:30001 not responding.

nameserver <primary_host>:30001 not responding.

System Replication State

~~~~~~~~~~~~~~~~~~~~~~~~

mode: none

done.

I will post nameserver.ini file in few mins.

Ask a Question