SAP HANA DATABASE INVESTIGATION CUM ANALYSIS DOCUMENT

Prepared by:
Mohammed Azher Ul Haque, MCA, M. Tech - Technical lead – SAP Certified Basis HANA-Hyderabad, India. Mobile: 9346344403

There are many different options available to collect an RTE dump and all other dumps and traces which are related to HANA
Database. Make sure you log on to the affected hana node as the <SID>adm user and root user for OS related logs.
SAP Support asks you to generate runtime dump(s) during a high CPU/Memory consumption, etc. Please find below all the
consolidated notes which are related to collecting the dumps, traces, logs, etc.
These below notes are very helpful and important for doing root cause analysis, performance tuning and troubleshooting
purpose.

1. 2400007 - FAQ: SAP HANA Runtime Dumps

https://launchpad.support.sap.com/#/notes/2400007

2. 2573880 - FAQ: SAP HANA Full System Info Dump

https://launchpad.support.sap.com/#/notes/2573880

3. 2462851 - How to generate a runtime dump - Guided Answers

https://launchpad.support.sap.com/#/notes/2462851

4. 2784291 - How to generate runtime dumps for a specific HANA service from command line
https://launchpad.support.sap.com/#/notes/2784291

hdbcons -p 37312
runtimedump dump

5. 1813020 - How to generate a runtime dump on SAP HANA

https://launchpad.support.sap.com/#/notes/1813020

Login with sidadm user and jump to python directory using command cdpy
 SAP HANA DATABASE INVESTIGATION CUM ANALYSIS DOCUMENT
Prepared by:
Mohammed Azher Ul Haque, MCA, M. Tech - Technical lead – SAP Certified Basis HANA-Hyderabad, India. Mobile: 9346344403
 SAP HANA DATABASE INVESTIGATION CUM ANALYSIS DOCUMENT
Prepared by:
Mohammed Azher Ul Haque, MCA, M. Tech - Technical lead – SAP Certified Basis HANA-Hyderabad, India. Mobile: 9346344403

cdpy

python fullSystemInfoDump.py --rtedump --tenant=MSH --sets=3 --interval=5 --services=indexserver

cd /usr/sap/MSH/SYS/global/sapcontrol/snapshots

ls -latr | grep 'fullsystem*'

6. 2166414 - Capture OS Kernel Stack Backtraces

https://launchpad.support.sap.com/#/notes/2166414

Login as root user on your server and run the following command:

echo l > /proc/sysrq-trigger

This command will write the current kernel stack backtraces into the file /var/log/messages. Ideally the command should be
executed several times with a short distance of time (30-60 seconds).

The file /var/log/messages has to be provided to SAP Support.

7. 2313619 - How-To: Generating and Evaluating SAP HANA Call Stacks

https://launchpad.support.sap.com/#/notes/2313619

8. 1804811 - SAP HANA Database: Kernel Profiler Trace

https://launchpad.support.sap.com/#/notes/1804811

9. 1875973 - SAP HANA Studio: Kernel Profiler Trace

https://launchpad.support.sap.com/#/notes/1875973
10. 2399990 - How-To: Analyzing ABAP Short Dumps in SAP HANA Environments

https://launchpad.support.sap.com/#/notes/2399990
11. 1999670 - How-To: Performing Operating System Load Analysis using "sar"

https://launchpad.support.sap.com/#/notes/1999670

12. 2376233 - How To collect SAR / SYSSTAT information to debug high load or hang situations

https://launchpad.support.sap.com/#/notes/2376233
 SAP HANA DATABASE INVESTIGATION CUM ANALYSIS DOCUMENT
Prepared by:
Mohammed Azher Ul Haque, MCA, M. Tech - Technical lead – SAP Certified Basis HANA-Hyderabad, India. Mobile: 9346344403

https://www.slashroot.in/examples-using-sar-command-system-monitoring-linux

13. 2764266 - How to get Network Trace and Console Logs

https://launchpad.support.sap.com/#/notes/2764266
14. 2119087 - How-To: Configuring SAP HANA Traces

https://launchpad.support.sap.com/#/notes/2119087

15. 1999020 - How-To: SAP HANA Troubleshooting when Database is no longer accessible

https://launchpad.support.sap.com/#/notes/1999020

16. 1943937 - Hardware Configuration Check Tool - Central Note

https://launchpad.support.sap.com/#/notes/1943937

17. 2000000 - FAQ: SAP HANA Performance Optimization

https://launchpad.support.sap.com/#/notes/2000000

18. 1999993 - How-To: Interpreting SAP HANA Mini Check Results

https://launchpad.support.sap.com/#/notes/1999993

2498739 - How-To: Analyzing Runtime Dumps with SAP HANA Dump Analyzer

https://launchpad.support.sap.com/#/notes/2498739

19. 2399979 - How-To: Configuring automatic SAP HANA Data Collection with SAP HANASitter

https://launchpad.support.sap.com/#/notes/2399979

20. 2699939 - SAP HANA Emergency Suitcase

https://launchpad.support.sap.com/#/notes/2699939

21. . From HANA Studio - Trace Collection

From HANA Studio - SQL Editor

1) Log into HANA with a user with privileges enough to run procedure SYS.MANAGEMENT_CONSOLE_PROC;

2) Execute procedure SYS.MANAGEMENT_CONSOLE_PROC as a prepared statement;

3) Fill in parameter 1 with 'runtimedump dump' and parameter 2 with '<hostname>:<indexserver port>' (whithout quotes)
and execute the statement;

4) Download the generated rtedump file and attach it to the message.

The screenshots below depicts an example of how to record that dump in Studio:
 SAP HANA DATABASE INVESTIGATION CUM ANALYSIS DOCUMENT
Prepared by:
Mohammed Azher Ul Haque, MCA, M. Tech - Technical lead – SAP Certified Basis HANA-Hyderabad, India. Mobile: 9346344403

4) From HANA Studio - Trace Collection

SAP HANA Studio SP8 adds the possibillity of recording one or multiple samples of runtimedump based on a certain time
frequency.

For instance we can record a set of 5 runtimedumps, 1 every minute for every host or for a particular host only. Here are
the steps:

1) Go to Administration -> Diagnosis Files;

 SAP HANA DATABASE INVESTIGATION CUM ANALYSIS DOCUMENT
Prepared by:
Mohammed Azher Ul Haque, MCA, M. Tech - Technical lead – SAP Certified Basis HANA-Hyderabad, India. Mobile: 9346344403
2) Select "Diagnosis Information -> Collect...";

3) Set the option 'Create and collect one or multiple sets of runtime environment (RTE) dump file(s)';

4) Set the hosts, amount of samples (sets) and frenquency on which the runtime dumps will be recorded;

5) Finish.

22. 2520774 - FAQ: SAP HANA Performance Trace

https://launchpad.support.sap.com/#/notes/2520774

23. How to use HDBAdmin to analyze performance traces in SAP HANA

https://blogs.sap.com/2014/01/14/how-to-use-hdbadmin-to-analyze-performance-traces-in-sap-hana/

24. 2710650 - Creation of full system info dump in SCP

https://launchpad.support.sap.com/#/notes/2710650

25. 618104 - "sapsysinfo" - Collecting system information on Linux

https://launchpad.support.sap.com/#/notes/618104

26. 1642802 - supportconfig - collecting a system overview on OS level

https://launchpad.support.sap.com/#/notes/1642802
 SAP HANA DATABASE INVESTIGATION CUM ANALYSIS DOCUMENT
Prepared by:
Mohammed Azher Ul Haque, MCA, M. Tech - Technical lead – SAP Certified Basis HANA-Hyderabad, India. Mobile: 9346344403

Supportconfig
/var/log/nts_mhaque_201012_0730.tbz
 SAP HANA DATABASE INVESTIGATION CUM ANALYSIS DOCUMENT
Prepared by:
Mohammed Azher Ul Haque, MCA, M. Tech - Technical lead – SAP Certified Basis HANA-Hyderabad, India. Mobile: 9346344403
27. 2491748 - How-To: Analyzing Runtime Dumps with SAP HANADumpViewer

https://launchpad.support.sap.com/#/notes/2491748

28. 2498739 - How-To: Analyzing Runtime Dumps with SAP HANA Dump Analyzer

https://launchpad.support.sap.com/#/notes/2498739