You are on page 1of 6

Current Medicine Research and Practice 10 (2020) 110e115

Contents lists available at ScienceDirect

Current Medicine Research and Practice


journal homepage: www.elsevier.com/locate/cmrp

Review Article

The importance of clinical audit in India


Uma Perumal a, *, Meeta Rajivlochan b, Samiran Nundy a
a
Department of Surgical Gastroenterology and Liver Transplantation, Sir Ganga Ram Hospital, New Delhi, India
b
National Commission for Women, Government of India, India

a r t i c l e i n f o a b s t r a c t

Article history: Clinical audits, by comparing patient care processes with self-defined standard protocols, encourage a
Received 17 April 2020 healthcare model that is more responsible and patient-centric. They also provide valuable feedback to
Accepted 20 May 2020 medical practitioners, hospital managements and policy makers although there is a fear that a set of
Available online 26 May 2020
norms imposed from above may restrict the context-dependent judgment of practitioners. For clinical
audit to work in a country as diverse as India, we suggest a bottom-up model of clinical audit rather than
Keywords:
one which is top-down. Since clinical audit provides feedback to practitioners, it is important to involve
Clinical audit
them in developing the audit norms. Standardized protocols are the key to a health system that cares for
Healthcare in India
Optimal treatment
patients and clinical audits will always be needed even after greater resources for healthcare become
Better resource utilisation available here - indeed they are mandatory in most Western countries. They also have the potential of
establishing a stronger bond of trust between patients and healthcare providers.
© 2020 Sir Ganga Ram Hospital. Published by Elsevier, a division of RELX India, Pvt. Ltd. All rights
reserved.

1. Introduction clinical audit. The first is that an admission that the quality of care
can vary depending on a large number of factors specific to the
A universal healthcare system in India in the near future is a healthcare facility rather than to the patients treated, in itself
distinct possibility. However as and when such a system comes into presumes comparison of facilities and providers by third parties,
being, it is important for us to radically re-orient our current whether government or public, on the basis of some data. It also
practice and create a patient-centric model. We suggest that one presumes the existence of medical error or deviation from protocol.
strategy to achieve this could be, to encourage the compulsory use Given that patient care routinely sees life threatening situations, to
of clinical audits which, by comparing patient care processes with question treatment decisions can be full of danger. Hence any
standard protocols, encourage the use of the best healthcare genuine effort at clinical audit must consciously refrain from
models and provide valuable feedback to practitioners and makers degenerating into a fault-finding exercise. No doubt, for any degree
of policy. of objectivity, it would be important to associate an external agency
The intrinsic value of the idea of a clinical audit lies in providing with a clinical audit. However, it is even more important to involve
systematic feedback to healthcare providers so that they might be those who provide care within the facility with the conduct of
able to learn from experience and improve patient care. To say that audit, and to provide them systematic feedback.
learning from experience is possible, presumes that there is scope The second area of concern follows from the first. A clinical audit
for improvement to begin with. To that extent, medical audit pre- or rather any audit is only possible against some established or well
sumes that healthcare facilities across space and time have varying accepted norms for providing care. Insofar as medical practices vary
levels of care independently of the health profile and disease profile widely not only within the country but within the same region, city
of patients treated. This idea has existed in the Western world since and even village, many doctors often contest the idea of following
the 1850s but it continues to generate concern in the medical any set of norms that claim to guide them or to supersede their
community till today. independent judgement. Today there are hardly any standard
There are two kinds of concerns expressed in the debate over treatment protocols in India even for widely prevalent diseases. The
efforts made by institutions like the National Accreditation Board
for Hospitals (NABH) to set up some norms have little currency in
India-the numbers of facilities accredited by the NABH numbered
* Corresponding author.
E-mail address: uperumal@icloud.com (U. Perumal). only 662 till March 2020.1 And it does not seem as if the situation

https://doi.org/10.1016/j.cmrp.2020.05.010
2352-0817/© 2020 Sir Ganga Ram Hospital. Published by Elsevier, a division of RELX India, Pvt. Ltd. All rights reserved.
U. Perumal et al. / Current Medicine Research and Practice 10 (2020) 110e115 111

will change rapidly in the near future. operation. For complications there are now grades described
It is even possible that the NABH efforts are seen as an exercise by Clavien and Dindo5 which are being followed worldwide
by a group of medical professionals to claim authority that others and make comparisons easy. The criteria should be unam-
are reluctant to grant them. biguous and we should define standards e.g. operative
The absence of any country-wide health care norms either for mortality which should be relevant locally to be ‘minimal’ or
infrastructure in health facilities or for patient care processes ‘optimal’ always keeping in mind the ‘ideal’ results that have
including treatment protocols, should not be taken to mean that been achieved elsewhere.
clinical audits are not possible. To insist that such countrywide iii) Measuring level of performance e This is done by the
norms need to be generated first, would be self-defeating. collection and analysis of data, comparing the actual per-
Any audit that can check the services provided by a healthcare formance with the set standards, and if the standards are not
facility against norms standardized within the facility, can certainly met, noting the reasons for this.
provide valuable feedback for learning to the staff. For such audits iv) Making improvements- This entails presenting the results
to happen, the first step needed would be for the facility in question and discussing them with our colleagues in our hospital and
to document whatever norms they do follow and to maintain these elsewhere. We should use the results to develop an action
as internal reference points. The second step would be to maintain plan, specifying what needs to be done, how it will be done,
detailed records of treatment provided. who is going to do it and by when.
Issues of this nature are even more pertinent with the arrival of v) Maintaining improvements - This follows the previous stages
programmes like the Ayushman Bharat that aim to provide secondary of the audit, to determine whether the actions taken have
and tertiary care to a substantial section of the population. been effective, or whether further improvements are
Documentation of health care norms and of treatment decisions, needed. It involves repeating the audit/re-audit process (i.e.
whatever these might be, is essential for maintaining continuity of targets, results, discussion); hence the terms 'audit cycle' or
care. 'audit spiral' and entails “closing of the loop” of the audit
In this article we shall1 discuss the definition of what constitutes cycle. It is the most crucial step in the whole process to
a clinical audit and the steps involved2 briefly review the current improve efficacy in the desired area of interest. For instance,
methodology for conducting clinical audits in the developed world3 we found that our mortality after a Whipple's procedure
review the situation in India today and discuss constructive ap- (pancreaticoduodenectomy for cancer) was 13% during one
proaches to clinical audit that might ‘work’ for India and4 sum- year against an internationally accepted figure of less than
marize the way forward. 5%. When we audited our results, we found that the deaths
had occurred in patients who had serum bilirubin levels
2. Definition of clinical audit and the steps involved above 15 mg/dl and who were in continuing sepsis. When,
by draining the bile ducts preoperatively using plastic stents,
Clinical Audit is a process used by healthcare professionals to we brought the bilirubin levels down and controlled the
assess, evaluate and improve care of patients in a systematic way. It infection in this subset of patients, the operative mortality
measures current practice against a pre-defined set of standards came down to 4%. This could only have been achieved
and provides a framework to enable improvements in care and to because we maintained and continue to maintain a strict
safeguard and provide a high quality of clinical care to patients. clinical audit.
How those standards are defined, would have important implica-
tions for the overall acceptance of the process and its perceived
value among health care providers in India.
Clinical audit is based on three kinds of protocols that determine
quality of care2,3 those that govern1 structural facilities in a hospital
such as fitting out operation theatres, nurse-patient ratios and
qualifications of personnel,2 patient care processes in a hospital
such as clinical pathways followed in treating patients including
use of appropriateness criteria, use of surgical safety checklists and
constitution of infection control committees3 patient related out-
comes such as recovery and complications. All these protocols put
together are designed with one simple objective: to see that pa-
tients recover in the shortest possible time and that the health
status they achieve is sustained even after leaving a hospital. This is
the question that must be asked throughout the patient's journey in
the hospital and if possible, outside it as well.

2.1. How it is done. The audit cycle

a. Audit is usually conducted in five stages.4


i) Preparation e This consists of choosing a topic which is a
high priority for the organization involved. For instance, in
our department, we choose to audit demographic data on
the patients we admit, data on what procedures we perform,
what complications follow and whether there is post-
operative mortality.
ii) Select criteria e the next step is to unambiguously define the Fig. 1. Schematic representation of an Audit cycle.
criteria. Even for mortality we may choose death during the
same hospital admission or within 30 days or 90 days after
112 U. Perumal et al. / Current Medicine Research and Practice 10 (2020) 110e115

The audit cycle is diagrammatically depicted in Fig. 1 and an improve patient care. All these learnings have been put together
example of the audit we follow is in Fig. 2a, b and c. in various Quality Improvement programmes for healthcare
outcomes. In the United Kingdom, the National Health Service
3. Current clinical audit methodology in developed countries has a special audit department called The National Clinical Audit
and Patient Outcomes Programme (NCAPOP)6 and the USA has
In the developed world, increasingly there are laws to take the National Surgical Quality Improvement Program (ACS
care of structural factors in healthcare facilities. Laws mandate NSQIP®)7 which is a nationally validated, risk-adjusted, out-
the qualifications of medical practitioners and paramedics who comes-based programme to measure and improve the quality of
may be employed in a healthcare facility and what procedures surgical care.
they may perform. There are rules that make it mandatory for Under the National Surgical Quality Improvement Program, a
healthcare facilities to have generator backup for operation study of data regarding 87,078 operations at 44 Veterans Admin-
theatres. Accordingly, the focus of clinical audits in the devel- istration centers in USA worked out risk adjusted mortality and
oped world has increasingly shifted to process and outcome morbidity rates respectively for different surgical specialties.8,9 The
measures. relationship between structure, process and outcomes was vali-
Clinical audits in those countries have existed in some form or dated.10 Some estimates say that as a result of the Quality
another for over one hundred years. Conscious efforts are made Improvement programs, morbidity and mortality rates saw re-
to record various parameters of patient care processes and to ductions of 45% and 27% respectively.11

Fig. 2. (a). Trends in the number of emergency and elective procedures performed between 1997 and 2019. (b). Procedures performed according to organ systems. (c). Data
illustrating all procedures done on Stomach with Morbidity rates.
U. Perumal et al. / Current Medicine Research and Practice 10 (2020) 110e115 113

Most of these countries follow a top-down approach to clinical care provided. But the numbers of NABH accredited facilities re-
audit. A central authority is invested with legal status and the re- mains miniscule till today; nor do we have evidence that such
sources to demand compliance. bodies have been able to popularize the concept of clinical audit.
In a survey of the attitude to medical audit of doctors from the
3.1. Is there evidence that audit is effective? Nizam's Institute of Medical Sciences in Hyderabad, one of the
major super-specialty hospitals in this country, while 86% practi-
The effectiveness of clinical audit continues to be a controversial tioners thought that conducting audits was important, 0%, i.e. not a
issue.12 Audit and feedback have not been consistently found to be single department, was ‘following an audit system’.15
reliable. A systematic review13 found that providing health practi- Today, as individual incomes rise, there has been a significant in-
tioners with data on their performance in the form of evaluations crease in health seeking behaviour among Indians and in health-
and feedback could help enhance their practice. However, the re- related expenditure. India has also become one of the major desti-
sults of the assessments included in the analysis varied widely, nations for medical tourism worldwide. Yet, an increase in health
from obvious negative to very significant positive results. The ef- expenditure has by no means created a demand for improvement in
fects were mainly small to moderate when they were successful. the quality of care. Given the vulnerability of patients and the dearth
The analysis concluded that the efficiency of the audit and feedback of well-informed patient centric discussions in public spaces, perhaps
was likely to be higher when baseline adherence to the prescribed it is unrealistic to have such expectations. Fortunately, in recent years
protocol was improved and feedback was more intensive. Part of there has been a small body of physicians themselves who discuss
clinical governance is to determine whether patients are being evidence-based medicine and who have tried in their own individual
provided the best level of care. It is therefore important that we ways, to set up mechanisms for clinical audit, wherever possible. In
monitor the process of care and recognize when it is required to the absence of legislation, these remain isolated efforts.
improve it. Audit provides us with the best available method to A significant change in the public health discourse in India has
accomplish this goal, and hence should be widely practiced. been brought about by the entry of large government funded third
party insurance programs in the last two decades. These pro-
a) Advantages of the audit process - Many doctors who practice grammes seek to purchase the services of private providers for
clinical audit feel that it helps them improve professionally, insured families. Major states like Andhra Pradesh, Tamil Nadu,
improves communication among various disciplines and Karnataka, Maharashtra, Gujarat have instituted such programmes.
various levels of personnel involved and encourages good data The most recent entry has been the mega insurance scheme called
keeping and research. Good audit probably improves patient the Ayushman Bharat, funded by the Government of India. Today
care and provides professional validation for the healthcare these schemes account for almost one third of all health insurance
provider expenditure in India. While this has led to a serious infusion of
b) Disadvantages of audit e However many perceive it to be a funds in healthcare, there has been no documented increase in
waste of time and feel that it detracts from patient care. Some clinical audits or the use of accreditation mechanisms.
are reluctant to criticize others in order not to cause offense, or Such health insurance schemes could conceivably be used as a
be questioned themselves, in turn. They may also refuse to adopt platform to introduce quality of care indicators in the hospitals
the standards defined, perceive audit as a professional threat, empanelled with various governments at the state and the Centre.
with fear of unfair criticism, intimidation and ridicule. A further However, till date, most state governments have tended to focus on
serious objection, especially in developing countries where the structural indicators of patient care like availability of well equip-
resources are so limited, is that a strict audit may curb profes- ped operation theatres, qualified staff etc. Such indicators are
sional creative freedom, restricting practice to a prescribed concrete; easy to understand and evaluate. What is problematic is
policy and discourage innovation. There is an oft quoted saying that there is no clear established relationship between good
that we in developing countries follow every day - ‘Think global infrastructure and good clinical outcomes. In the absence of data on
but act local’- use the data generated elsewhere which is outcomes, it is difficult to say that five-star and even seven-star
appropriate, as well as applicable, to a particular patient hospitals offer better patient outcomes than public hospitals.
encounter. The one case where some attempt was made to use process and
outcome indicators, was in the state of Maharashtra. In this state,
4. Clinical audit in India the government had partnered with public sector insurance com-
pany, the National Insurance Company, in 2012. In 2013, they
In 1959, the Ministry of Health and Family Welfare, Government launched an appraisal tool for empanelment of hospitals using all
of India, set up a Committee to undertake the review of the de- three categories of indicators-structure, process and outcome. This
velopments that had taken place since the publication of the report tool included 85 standards to evaluate health care facilities.16 These
of the Bhore Committee in 1946 with a view to formulate further indicators were grouped into nine separate chapters, namely: 1)
health programs for the country in the subsequent five-year plan Human resources 2) Infrastructure and Facilities 3) Infection Con-
periods. This committee headed by Dr. A. Lakshmanaswami trol 4) Medication Monitoring 5) Patient Medical Records 6) Stan-
Mudaliar, submitted its report in 1962. In the report, amongst other dard Operating Protocols 7) Quality of Patient Care 8) Transparency
issues, emphasis was laid on the importance of medical audit (14 in Pricing and 9) Patient Satisfaction Indices. The appraisal tool is
which was proposed as a standard function for all government being used till today in running the scheme.
hospitals in India by Dr. Sushila Nayyar, Indian Minister of Health in While all these schemes routinely collect humongous data, the
1969. data has not been made available in the public domain or even to
But despite all these good intentions, clinical audit came into medical colleges for research purposes. Nor do we know whether
reality only after 2006, after accreditation bodies came into exis- any of the data is provided to the empaneled hospitals by way of
tence, like the NABH. This was established in 2005; it is a constit- feedback to improve current practice.
uent board of the Quality Council of India, set up to develop and Given such a decentralized healthcare universe and the vastness
operate an accreditation system for healthcare organizations. It of India, it is worth exploring whether a bottom up approach, might
streamlines the functions of hospitals at all levels and necessitates be more workable for us. It is here that the concept of clinical audit
audit process to establish continual improvement in the quality of becomes so valuable.
114 U. Perumal et al. / Current Medicine Research and Practice 10 (2020) 110e115

Clinical audits being protocol based, are in themselves very entirely voluntary model of accreditation. It was colleges and uni-
patient-centric. Any universal healthcare system of international versities who realized that in a world driven by rankings, students
quality, should prioritize better health status for patients over all needed some reliable source of information about the credentials of
other factors. What are the kind of systems that care for patients? the institutions they were applying to. NAAC merely put all its
The answer is simple: systems that are structured around standard parameters in the public domain and positioned itself as a body
medical protocols actually care for patients. The availability of re- that would assist institutions of higher education. This simple fact
sources is a subordinate issue. However much or little money is had the impact of improving the outcome of teaching and research.
pumped into the system, whether one condition or one thousand NAAC charged for providing its services-institutions paid up will-
are treated, the only way to build a patient centric system is to ask ingly. It is only in the last few years that state governments have
what is the health status of the patient at every stage of treatment, started saying that funds would only be released to NAAC
to record the answer and to collate the data.17 In the absence of this accredited institutions and not to others.
focus, it is difficult to see how pumping money into the system If such a voluntary model could be adopted for clinical audit in
could in itself achieve any significant improvement in patient care India, it can offer the great positive that it would actively involve
outcomes. physicians in developing parameters that might work for them and
While the professional practice of medicine is protocol driven; facilitate a buy-in. Putting these in the public domain would
documentation of the underlying norms and treatment decisions encourage transparency.
has been the exception rather than the rule. Continuous docu-
mentation of norms and treatment decisions, in itself, can be a 5. Summary and the way forward
powerful force working towards greater accountability.
Clinical audits essentially compare patient care processes and A healthcare system that incorporates regular clinical audits, is
outcomes with standardized protocols and merely by doing so, they built on the premise that a cycle of learning can lead to continuous
encourage greater compliance with the protocols. To that extent improvement. Even apart from the quantifiable benefits of clinical
they are important to any healthcare system that hopes to provide a audits in the sense of improvement in patient related outcomes,
high quality of care. there are several social benefits of audit that are worth considering.
The healthcare market in India can only expand from this point Firstly, merely the act of comparing practice with protocol, en-
onwards. With the mushrooming of hospitals, patients have a wide courages practitioners to comply with the protocols. Even the most
variety of hospitals to choose from. The competition between basic activity of recording patient history, if done consistently, can
hospitals to treat patients and increase footfalls has become lead to great improvements in continuity of care. Secondly, the
intense. In addition, the number of malpractice and negligence activity of conducting a clinical audit, builds up a large body of
cases against healthcare providers is rising. This places added documentation that is available for remedial action of any kind.
pressure on organizations and clinicians to determine the level of Without such data, the possibility of remedial action cannot exist.
care provided. Clinical audits, by demonstrating that standard Thirdly, ascertaining whether the protocols have been followed in
protocols have been followed, can protect healthcare providers any given situation, can provide significant protection to healthcare
from malpractice suits. They can also help in building trust between providers against malpractice suits. Fourthly and perhaps this is the
physician and patient. The process of audit ensures consistency in most important, by building a body of data, by documenting norms
delivery of clinical and non-clinical services; it also addresses the and treatment decisions and by encouraging transparency in pa-
habit of continual improvement. tient care, healthcare facilities can help rebuild trust between
No doubt any sustainable approach to medical audit would physician and patient. All these factors put together, can truly help
require the existence of some third party to offer assistance to India in putting together a system of universal health care that can
health care facilities that wish to institute such an audit. However, serve as a model for the rest of the world.
to arm such a third party with punitive authority or even authority
to dictate content, might well be counter-productive. The entire Acknowledgements
objective of a clinical audit is to provide continuous feedback to
clinicians on the results of treatment provided by them. In such a The authors acknowledge the inputs provided by Dr. Udit
situation, it makes greater sense to involve the clinicians in the Vinayak, Sancheti Institute for Orthopaedics & Rehabilitation, Pune
development of the standards too. and Mr. Parmanand Tiwari, Sir Ganga Ram Hospital.
Given the difficulty of securing consensus on a vast variety of The views expressed in this article are personal.
protocols, an alternative method could be to encourage physicians
to document whatever protocols they do follow on various pa-
References
rameters of patient care. A third party could provide an overall
framework and the parameters on which protocols should be 1. National accreditation board for hospitals & healthcare providers (NABH)
developed. The rest can be left to individual facilities and physicians [Internet]. Available from: https://www.nabh.co/frmViewAccreditedHosp.aspx.
themselves. Reducing what is being done to writing, would be a Accessed April 7, 2020.
2. Donabedian A. Evaluating the quality of medical care. Milbank Q. 2005.
major step forward. 1966;83(4):691e729.
What the parameters of audit are, could be discussed. But the 3. Mainz J. Defining and classifying clinical indicators for quality improvement. Int
need to document the norms and to maintain treatment records is J Qual Health Care. 2003;15(6):523e530.
4. National institute for clinical excellence, royal college of nursing, university of
the basis of all patient care. Even such basic SOPs like writing Leicester, commission for health improvement. In: Scrivener R, ed. Principles for
Operation Theatre notes instead of merely writing the name of the Best Practice in Clinical Audit. Repr. Abingdon: Radcliffe Medical; 2004:196.
procedure performed, are till date, not standardized in patient care 5. Dindo D, Demartines N, Clavien P-A. Classification of surgical complications: a
new proposal with evaluation in a cohort of 6336 patients and results of a
in the country.
survey. Ann Surg. 2004;240(2):205e213.
Actually, we already have a successful model for accreditation 6. Foy R, Skrypak M, Alderson S, et al. Revitalising audit and feedback to improve
and audit that has been followed in the higher education sector in patient care. BMJ. 2020;368:m213.
India. The NAAC (National Assessment and Accreditation Council), 7. National Surgical Quality Improvement Program [Internet]. Chicago, IL: American
College of Surgeons; 2005. Available from: www.acsnsqip.org. Accessed April 7,
was set up in 1994 as an autonomous institute of the University 2020.
Grants Commission. Ever since those days, it has followed an 8. Khuri SF, Daley J, Henderson W, et al. Risk adjustment of the postoperative
U. Perumal et al. / Current Medicine Research and Practice 10 (2020) 110e115 115

mortality rate for the comparative assessment of the quality of surgical care: Audit and feedback: effects on professional practice and health care outcomes.
results of the National Veterans Affairs Surgical Risk Study. J Am Coll Surg. Cochrane Database Syst Rev. 2003;(3), CD000259.
1997;185(4):315e327. 14. Govt of India-Ministry of health and family welfare, NHP India [Internet].
9. Daley J, Khuri SF, Henderson W, et al. Risk adjustment of the postoperative Report of the Health Survey and Planning Committee; 1961. Available from:
morbidity rate for the comparative assessment of the quality of surgical care: https://www.nhp.gov.in/sites/default/files/pdf/Mudalier_Vol.pdf. Accessed
results of the National Veterans Affairs Surgical Risk Study. J Am Coll Surg. April 6, 2020.
1997;185(4):328e340. 15. Bhaskar NL. Are we geared up for medical audit? e an endeavour for
10. Daley J, Forbes MG, Young GJ, et al. Validating risk-adjusted surgical outcomes: improvement of quality in health care. IOSR J Dent Med Sci. 2012;1(2):35e38.
site visit assessment of process and structure. National VA Surgical Risk Study. 16. Govt of Maharastra-RGJAY Empanelment Process and NABH Scoring and
J Am Coll Surg. 1997;185(4):341e351. Grading Criteria. available from: https://www.jeevandayee.gov.in/MJPJAY/
11. Khuri SF, Daley J, Henderson WG. The comparative assessment and improve- RGJAYDocuments/NABHcriteria.pdf. Accessed April 6, 2020.
ment of quality of surgical care in the Department of Veterans Affairs. Arch Surg 17. Karthikeyan G, Shirodkar U, Lochan MR, Birch S. Appropriateness-based
Chic Ill 1960. 2002;137(1):20e27. reimbursement of elective invasive coronary procedures in low- and middle-
12. Grimshaw JM, Shirran L, Thomas R, et al. Changing provider behavior: an income countries: preliminary assessment of feasibility in India. Natl Med J
overview of systematic reviews of interventions. Med Care. 2001;39(8):II2e45. India. 2017;30(1):11e14.
13. Jamtvedt G, Young JM, Kristoffersen DT, Thomson O'Brien MA, Oxman AD.

You might also like