/Oracle/<SID>/112_64/ directory goes blank after system restart

[Former Member]

Hi Experts,  

After our Linux server restart, the lsnrctl command not working from ORA<SID> user. We suddenly found /oracle/<SID>/112_64/ is empty. How to resolve it ? BDF command output is at below:

bdf

Filesystem          kbytes    used   avail %used Mounted on

/dev/vg00/lvol3    10485760 7014768 3470992   67% /

/dev/vg00/lvol1    2097152  373560 1710200   18% /stand

/dev/vg00/lvol8    50331648 1582320 48368744    3% /var

/dev/vg00/lvol7    16777216 12848240 3898416   77% /usr

/dev/vg01/lvol19   20971520 18262059 2540204   88% /usr/sap/trans

/dev/vg01/lvol20   20971520 6104412 13938205   30% /usr/sap/BCD

/dev/vg00/lvol6    8388608 3845056 4510800   46% /tmp

/dev/vg01/lvol18   20971520 1940378 17841829   10% /sapmnt/BCD

/dev/vg01/lvol17   15728640 8095713 7155877   53% /oracle/stage

/dev/vg01/lvol16   2097152  239668 1741394   12% /oracle/client

/dev/vg01/lvol13   2097152   87553 1887989    4% /oracle/BCD/saptrace

/dev/vg01/lvol12   5242880   18779 4897602    0% /oracle/BCD/sapreorg

/dev/vg01/lvol5    62914560 10895569 48767810   18% /oracle/BCD/sapdata4

/dev/vg01/lvol4    62914560 10895569 48767810   18% /oracle/BCD/sapdata3

/dev/vg01/lvol3    62914560 12964065 46828594   22% /oracle/BCD/sapdata2

/dev/vg01/lvol2    62914560 15326785 44613542   26% /oracle/BCD/sapdata1

/dev/vg01/lvol15   10485760   20358 9811321    0% /oracle/BCD/sapcheck

/dev/vg01/lvol14   10485760   20139 9811526    0% /oracle/BCD/sapbackup

/dev/vg01/lvol11   2097152   18006 1949207    1% /oracle/BCD/saparch

/dev/vg01/lvol9     524288  447015   72450   86% /oracle/BCD/origlogB

/dev/vg01/lvol8     524288  447015   72450   86% /oracle/BCD/origlogA

/dev/vg01/lvol10   41943040 23059841 17703101   57% /oracle/BCD/oraarch

/dev/vg01/lvol7     524288  427223   91006   82% /oracle/BCD/mirrlogB

/dev/vg01/lvol6     524288  427223   91006   82% /oracle/BCD/mirrlogA

/dev/vg01/lvol1    10485760   20062 9811600    0% /oracle/BCD/112_64

/dev/vg00/lvol5    20971520 5625144 15226528   27% /opt

/dev/vg00/lvol4    4194304   50848 4111176    1% /home

/dev/vg01/lvol21   157286400 112511642 41976389   73% /dump

Please help us asap.

[Former Member · Accepted solution]

HI all, thanks for your reply. The problem has been resolved. Main cause was the BASIS Consultant Installed oracle software with ORACLE_HOME into the directory /oracle//112_64, not into the filesystem. After umount this filesystem, the Binaries content came into this path. Thanks Asad

[Former Member · Accepted solution]

Hi Asad,

Good to hear..that may be you need to ask the basis guy to be more careful in future and follow up sap standard paths for the installations no Research on the other structure

Regards,

Ram

[former_member182657]

Hi,

Nice to know the issue has been resolved for now.Kindly close the thread .

Regards,

[former_member182657]

Hi Asad,

Hope you're with database backup with you to reinstall & restore the DB,as a workaround could you copy contents of directory /oracle/<SID>/112_64 from some other system from your existing landscape to the faulty one & give a nice try by modifying required copied files.(For the method 'm not sure but you could perform only & if you've complete database backup to avoid any inconsistencies).

In resume i also suggest you to raise support ticket with OS team as well as with SAP.

Hope this will help you.

Regards,

[Former Member]

Hi Asad,

APart from what gaurav suggest, Can you once check if the volume is correctly mounted.

and ask the OS team to unmount & remount it again if there is any issue with devices.

Also is there any error showing for the /dev/vg01/lvol1 in your systeg logs of OS.

And one more thing is is this volume a local or nfs as it says vg01/lvol1 seems to be mounted from nas. so just try the unmount & mount back once.

Do validate the same.

Regards,

ram

[former_member182657]

Hi,

/dev/vg01/lvol1    10485760   20062 9811600    0% /oracle/BCD/112_64

It's still showing used & available space stats for /oracle/BCD/112_64. Could you confirm the contents under the directory if any ? In resume please share any previous activities performed on the system before restart of the complete system.

If possible share alert_<SID>.log file as well.

Regards,

[Former Member]

HI Gaurav,

Thanks for your reply. But in the filesystem it is showing used space 0%. And there is nothing under the directory /oracle/BCD/112_64/ .

And I think alert_<SID>.log file exist in this directory, so i cannot give it to you. and no activities performed before restart of it. In this blade there are 7 vpar... among these 5 VPAR is ok and in two we are getting mentioned problems.

Asad

[former_member182657]

Hi Asad,

And I think alert_<SID>.log file exist in this directory

You could locate alert_<SID>.log file under system directory /oracle/<SID>/saptrace/diag/rdbms/<sid>/<SID>/trace.

Kindly check or search for the required file on the system.

Regards,

[Former Member]

HI Gaurav, I have attahced the log file here. Please check .

alert_BCD.txt.zip

[former_member182657]

Hi Asad,

Logs are only up to Sat Aug 22 12:31:58 2015.Could you confirm when this issue occurred ?

Regards,

[Former Member]

Sorry i forget to mention one thing,,, it was an unexpected shutdown on 22 august 12:30 PM .