on 11-07-2012 3:10 AM
My AWS HANA was working just fine all last week and starting yesterday, the instance won't start.I've been stopping and starting the instance about twice a day. Rebooting the VM didn't seem to help. Here are the symptoms as seen from the Linux shell after running the su - hdbadm command.
hdbsql=> select * from tpc.nation
* -10709: Connection failed (RTE:[89006] System call 'connect' failed, rc=111:Connection refused)
imdbhdb:/usr/sap/HDB/HDB00/exe/python_support> startsap
End program!
Starting with NGAP 2.0 the startsap/stopsap scripts will be removed
and is no more available.
For detailed information see Incompatible Change:
https://wiki.wdf.sap.corp/wiki/display/LeanByD/IC_0152
eclipse.buildId=unknown
java.version=1.7.0_09
java.vendor=Oracle Corporation
BootLoader constants: OS=win32, ARCH=x86_64, WS=win32, NL=en_US
Command-line arguments: -os win32 -ws win32 -arch x86_64
Error
Tue Nov 06 18:42:01 PST 2012
Instance not reachable: SAPControl request failed
com.sap.ndb.studio.sapcontrol.SAPControlException: SAPControl request failed
at com.sap.ndb.studio.sapcontrol.operations.SAPControlOperation.execute(SAPControlOperation.java:118)
at com.sap.ndb.studio.sapcontrol.SAPControl.getInstanceProperties(SAPControl.java:495)
at com.sap.ndb.studio.sapcontrol.SAPControl.collectProperties(SAPControl.java:522)
at com.sap.ndb.studio.sapcontrol.SAPControl.open(SAPControl.java:333)
at com.sap.ndb.studio.sapcontrol.SAPControlManager.getSAPControl(SAPControlManager.java:121)
at com.sap.ndb.studio.sapcontrol.SAPControlManager.getSAPControl(SAPControlManager.java:101)
at com.sap.ndb.studio.sapcontrol.SAPControlManager.getSAPControl(SAPControlManager.java:83)
at com.sap.ndb.studio.admin.model.system.impl.InstancesImpl.populate(InstancesImpl.java:401)
at com.sap.ndb.studio.admin.logfiles.jobs.CredentialsHelper.tryPopulateWithPasswordDialog(CredentialsHelper.java:133)
at com.sap.ndb.studio.admin.logfiles.jobs.SapstartsrvPrepareJob.populateEngineSapstartsrv(SapstartsrvPrepareJob.java:120)
at com.sap.ndb.studio.admin.logfiles.jobs.SapstartsrvPrepareJob.access$0(SapstartsrvPrepareJob.java:73)
at com.sap.ndb.studio.admin.logfiles.jobs.SapstartsrvPrepareJob$PopulateEngineCallable.call(SapstartsrvPrepareJob.java:35)
at com.sap.ndb.studio.admin.logfiles.jobs.SapstartsrvPrepareJob$PopulateEngineCallable.call(SapstartsrvPrepareJob.java:1)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: com.sun.xml.internal.messaging.saaj.SOAPExceptionImpl: com.sun.xml.internal.messaging.saaj.SOAPExceptionImpl: Message send failed
at com.sun.xml.internal.messaging.saaj.client.p2p.HttpSOAPConnection.call(Unknown Source)
at com.sap.ndb.studio.sapcontrol.operations.SAPControlOperation.execute(SAPControlOperation.java:94)
... 17 more
Caused by: com.sun.xml.internal.messaging.saaj.SOAPExceptionImpl: Message send failed
at com.sun.xml.internal.messaging.saaj.client.p2p.HttpSOAPConnection.post(Unknown Source)
... 19 more
Caused by: java.net.UnknownHostException: imdbhdb
at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
at java.net.Socket.connect(Unknown Source)
at java.net.Socket.connect(Unknown Source)
at sun.net.NetworkClient.doConnect(Unknown Source)
at sun.net.www.http.HttpClient.openServer(Unknown Source)
at sun.net.www.http.HttpClient.openServer(Unknown Source)
at sun.net.www.http.HttpClient.<init>(Unknown Source)
at sun.net.www.http.HttpClient.New(Unknown Source)
at sun.net.www.http.HttpClient.New(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.connect(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(Unknown Source)
... 20 more
Any help would be greatly appreciated.
Bill
Hi Bill,
Try the following from the Linux shell:
su - hdbadm
./HDB stop
./HDB start
Let us know if that helps
--Juergen
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi Juergen,
Stop worked ok. The Start command appeared to work ok as well. sqlhdb success! It's too bad that the stop command is not enabled in SAP HANA Studio when HANA gets stalled like this. Looks like the admin guide and your blog post needs a little updating - in part 5 of http://scn.sap.com/docs/DOC-28294
Thanks!
Bill
Bill,
You are spot on - the getting started guide still uses startsap and stopsap. These commands have been deprecated. I'll change the doc right away, thanks for catching that (I always use ./HDB, no idea why I listed startsap/stopsap at all)...
Regarding stopping from the studio - it should really work. I suspect you entered SYSTEM / <yourSYSTEMpassword> when prompted to login. If you read the popup carefully, you will see it asks for the <sid>adm credential, so you have to login as hdbadm. You can change this in the properties of the connection, "SAP System Logon"
Cheers
--Juergen
Hi Juergen,
Thanks for getting the AWS guide updated. When my AWS instance gets into the state where it doesn't start after stopping in the AWS instance, HANA Studio simply doesn't have the Stop command enabled. This is before I'm prompted for the login. I tried issuing the Start command with the hdbadm user and it wouldn't work. Looks like the linux command shell is the only way to get the HANA DB up and running again. This mught be something to pass along to the HANA Studio team.
Thanks,
Bill
I experience the same issues/error like Bill.
However stop & start doesn't help in my case. I may have 'overloaded' the database with data on a data generation process. I misscalculated the available RAM space and I think this caused the indexsserver to crash.
After ./HDB start I am seeing a very fast memory consumption for the indexserver on top statistics and suddenly all the memory is released again and this message shows up:
....
StartWait
FAIL: process hdbindexserver HDB Indexserver not running
I suspect a specific table which I want to delete, but I am unable to access the server console nor HANA Studio.
Is there any way to remove this manually on the harddisk and then reinitialize. I couldn't find anything about this. If this granularity is not possible, can I get rid of a complete namespace and then restart?
Thanks in advance
Jens
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi Jens,
I reported a similar issue a while back - see http://scn.sap.com/thread/3293248. Essentially I terminated the HANA One instance and created a new one - this time keeping track of the memory I was using. I also switched all my larger tables to use column versus row tables.
Regards,
Bill
Hi Jens,
My suggestion is to go with column table with that many rows. Remember - row tables need to completely fit into memory don't have any compression! You also saw the consequence of going too far . You also have to account for any indexes that you might have created for your memory consumption.
HANA is fairly efficient at inserts and updates with column tables as long as you make sure you are doing the delta merge on a regular basis. If you run into memory pressure, HANA will page data back out to disk from memory. With HANA One on AWS, you can also optimize the log processing speed by creating a provisioned IOPS drive (solid state) and then mounting it to your HANA One instance. You can then configure HANA to use the new drive as the log drive. This is essentially how the HANA appliances are configured and the way SAP originally envisioned configuring HANA One. The problem is that a provisioned IOPS drive is much more expensive than a standard EBS Raid0 configuration and that SAP didn't want people to have sticker shock when they got their bill at the end of the month from AWS. But, that's the great thing about AWS - if you need the horse power - they can generally deliver.
Regards,
Bill
User | Count |
---|---|
84 | |
23 | |
11 | |
9 | |
8 | |
5 | |
5 | |
5 | |
5 | |
4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.