Professional Documents
Culture Documents
PHYSIOTHERAPY MODULEs
Published by:
College of Physiotherapy
Sumandeep Vidyapeeth University,
Piparia, Waghodia, Vadodara.
2016
FIRST
[Type text]
EDITION
FIRST EDITION
EVIDENCE BASED
PHYSIOTHERAPY
MODULES
Published by:
2
PREFACE
The commitment to evidenced based practice (EBP) emerges as the need of the hour. Use of
EBP is believed to be an important means by which physiotherapists can deliver safe and
effective interventions, avoid use of ineffective and potentially detrimental methods, and thus
avoid wasting precious resources which are allocated to healthcare. Early education on the
foundations of EBP is advocated as a potent intervention toward enhancing EBP uptake among
physiotherapists.
The World Confederation for Physical Therapy (WCPT) strongly advocates teaching the
principles of EBP in undergraduate physiotherapy curricula. This booklet is an attempt to
provide an introduction to the skills required for evidence-based practice for undergraduate
students. We hope that this book serves to be a useful resource /guide for the UG students
providing them with details on strategies for searching for evidence, critically appraising the
evidence ultimately integrating & communicating the evidence to the various stake holders.
3
INDEX
6 Levels of evidence 35
7 Statistics 38
9 Outcome Measures 43
10 Critical Appraisal 48
12 Inferential statistics 77
13 Economic evaluation 82
4
Chapter – 1 INTRODUCTION TO EVIDENCE BASED PRACTICE
What is Evidence?
Purchase bill is the evidence of the products purchased from the grocery shop. If you do not
show purchase bill at exit door of a mall, then you will not be allowed to go out and it will
be thought as you have stolen the goods.
Exercises:
Assignment:
5
Evidence Based Practice
Brief History: The roots of evidence-based practice are in evidence-based medicine. In 1972,
the importance of properly testing the effectiveness of health care strategies, to provide
evidence on which health care is based was initiated. Later in 1992, the term "evidence-based
medicine" was introduced by Dr. Gordon Guyatt which was further explained by Dr. David
Sackett in 1996as a combination of not only research evidence but also clinical expertise (expert
opinion), taking into account the patient’s preferences (choices). Since then, evidence-based
decision making has been widely accepted by allied health areas and David Sackett is called as
the father of evidence-based medicine.
Definition by David Sackett, EBP is “the conscientious, explicit and judicious use of current best
evidence in making decisions about the care of the individual patient. It means integrating
individual clinical expertise with the best available external clinical evidence from systematic
research”
Let’s understand with an example: You are suffering from common cold. You think to have a
medicine to get relief from cold. But there are many medicines available in the market for
6
common cold. So before purchasing tablet you will take opinion of your parent or friends about
which tablet gives fast recovery from cold or which tablet gives good results from cold. Once
you know that then only you will purchase that tablet. Many of them suggest that tablet X gives
good results. So, the evidences stating that tablet X must be taken to get relieve from common
cold is based on their individual experiences.
Evidence Based Physiotherapy Practice is when a therapist makes a clinical decision about the
physiotherapy management of a patient, by proper steps taken to arrive to a conclusion,
knowing the rationale (reasons) behind the decision, giving a thought for what will be the
positive / negative impact of such clinical decision on patient and also integrating patient’s
preferences (choices) and values.
For e.g. a female patient with back pain comes to physiotherapy department to take the
treatment. After following the appropriate steps and arriving at conclusion that massage is very
useful in reducing pain and spasm in low backache patient. So, therapist decides to include
massage in the treatment after giving a thought of its positive impact on the patient. But
patient prefers to take massage therapy from a female therapist rather than a male therapist
due to her social values. So, the therapist has to respect the choice (preference) of the patient
before giving treatment.
We need to study Evidence Based Practice to support our decision –making, So that our
decisions are based on best available evidences and that can be applied on patients which will
benefit them in the best way.
Exercise:
1. After completion of your 12th standard, you wanted to join physiotherapy course. But
there are many colleges in Baroda and other cities. Describe the reliable information
you collected for joining college of physiotherapy, Sumandeep University.
7
Concepts of EBP:
Single example for Awareness, Consultation and Judgment: After passing 12 th standard, you
wanted to join physiotherapy course. So you must have searched number of colleges available
in Baroda offering the same course (i.e. you must be aware that there are many colleges which
are functioning as physiotherapy colleges).After making list of different colleges, you started
consulting others for a suggestion on Physiotherapy College for admission (i.e. consultation)
and after getting positive reviews on college, you decided (i.e. Judgment)to join college of
8
physiotherapy, Sumandeep Vidyapeeth University after judging all the positive aspect of how
the college may give you best education and built a strong career.
Assignment:
9
Chapter – 2 DEVELOPMENT OF EVIDENCE BASED KNOWLEDGE
Development of EBP is necessary for safety and quality improvement in health care.
Patient safety practices are those that reduce the risk of adverse (harmful) events related to
exposure to medical care across a range of diagnoses or treatment.
E.g. 2: Bar coding to avoid patient safety errors and thus improves health care process.
Evidence Based Knowledge in health care - it is the cornerstone of Evidence Based Practice and
its main aim is to provide quality health care to the patients by various methods like
demonstration of health-promoting behaviors, etc.
10
E.g. 1: Dettol advertisement
E.g.2: During Swachata week (on Gandhi Jayanti), students of college of physiotherapy
demonstrated Hand sanitization technique (proper hand washing technique) to the students,
patients and their relatives for health promoting behaviors.
11
Development of Evidence Based Knowledge in the Professionals across Disciplines
There are increasing evidences stating that EBP can help healthcare professionals to improve
patient care quality. The backgrounds of different medical and allied health care professionals
naturally differ. Weng et al (2013) found important differences regarding EBP across the
professional groups. The important discrepancies across the profession which he found to be
wide enough were awareness of EBP, beliefs, attitudes toward EBP, knowledge of, skills in,
barrier to and behavior regarding EBP. He found that physicians and pharmacists were most
aware of EBP due to long history of exposure to and efforts to influence the use of EBP compare
toother fields. So the need to develop evidence based knowledge in the professional across
disciplines is necessary.
Positive perception - Active participation to learn Evidence Based Practice, not with the attitude
to avoid learning. E.g. searching for the evidence with curiosity when you face a particular
problem/question/patient condition.
High self-efficacy- To believe in own ability that you can do Evidence Based Practice.
To develop the knowledge of EBP across the professional groups, education and training to
some extent will increase positive beliefs as the confidence of the individual will increase and
this will result in change in the attitudes regarding EBP and thus will ultimately increase use of
EBPin practice.
12
Chapter – 3 SEARCHING FOR THE EVIDENCES
The rapid development of the Internet in recent years has made it a first choice for searching
information. The internet can provide access to information on all kinds of topics, of varying
quality and usefulness. The most frequently used source for evidence are search engines.
• According to Wikipedia ‘it is a software system that is designed to search for information
on World Wide Web [www.] ’
• Search engines enable you to find the information on a particular topic via the Internet
using a word or phrase.
• Search engines operate by creating and then searching a locally indexed database of
web pages.
Following are the name of common search engines for finding information including scientific
articles.
• YAHOO
• BING
• ASK.COM
13
What are keywords?
Regardless of what question you are seeking answers to or in which search engines we are
looking in to, you need to select search terms. Selecting search terms/keywords is to specify
words that tell the search engine what we are searching for.
A poorly constructed search may results in thousands of results (relevant or irrelevant to topic
of search) or none at all while searching in a search engine. Therefore, search terms/ keywords
should be carefully selected.
Here the keywords should be ‘Diet’, ‘Risk factor’ & ‘Cancer’. Also look for the alternating terms
that can be used to describe each of the keywords. As in above example, ‘Diet’ can be the
alternating term for ‘Food’.
Search for evidences/articles also gets specific by using Booleans during search in the search
engine.They are for literature searches that allow the user to refine and extend the terms of the
search. To combine different concepts in a search, you have to use Boolean operators. These
are logical operators that enable you to broaden or restrict a search.
Diet Cancer
14
e.g. 2 Diet AND Cancer
In this example, using the AND operator will retrieve all articles which mentions Diet
AND Cancer.
Diet Cancer
Diet Cancer
15
References:
16
Chapter – 4 STEPS OF EVIDENCE BASED PRACTICE
Health care professionals like physicians, therapists and nurses are taught on how to diagnose
and treat patients during their formal training in colleges and once they start to work they will
simply try to keep up their workload to treat patients the best they know how. It is a
challenging task to unlearn what one has learnt or to adopt to a new model of health care
delivery. It is difficult to incorporate Evidence Based Practice (EBP) for a busy health care
professional as it is also time consuming. There are five steps that will help a busy health care
professional to incorporate EBP into their practices to reduce the time consumption and to
learn how to effectively use EBP.
17
Step 1: ASK a clinical question to identify a key problem.
Though we may ask ourselves many questions we may not try to find answers for all our
questions. Pursuing answer for a question depends on many factors like importance of such
question in our practice, availability of Time and resources, are we regularly getting answers for
our questions which helps us to keep up our motivation, out interest in finding an answer and
lastly do we have the patience to pursue an answer.
The types of information needs that arise regularly from our clinical practice are those
questions such as Why do we do it this way? or What's the best way of ....? for which we
generally don’t have a ready answer.
For example, using pain diaries is a common practice, especially in a palliative care, and
considered to be useful. One can also argue that monitoring one's pain in a diary actually
heightens one's awareness and experience of pain so pain diaries can do harm rather than
useful. Now we really don’t know completing pain diaries are useful or harmful and we need to
search the literature to find out if there was any such research.
18
Questions are generally typified into structured, semi structured and unstructured questions. A
Structured question is a question that is pre decided, follows a pattern and tries to find a
specific information as an answer. Structured question is carefully and thoughtfully formed so
that the search for evidence is easier. The structured question makes it relatively
straightforward to elicit and combine the appropriate terms needed to represent the need for
information in the query language of whichever searching service is available to us.
One of the fundamental skills required for practicing Evidence based practice is the asking of
well-built / structured clinical questions. To benefit patients and clinicians, such questions need
to be both directly relevant to patients’ problems and phrased in ways that direct your search
to relevant and precise answers. Framing the question in a way which lends itself to searching
while still reflecting the specific patient or service focus is an important stage to get right. That
way, when we begin searching for evidence on the topic we have chosen, the volume of
research will be manageable.
Before beginning to hunt for evidence, we need to spend some time making the questions
specific since structuring and refining the question makes it easier to find an answer. A
structured question for the above pain diary example would be: does the use of pain diaries in
the palliative care of patients lead to improved pain control?
But it’s not often easy to convert a clinical scenario in to a structured question. One way to
structure a question is to break the problem into parts. We usually break questions about the
effects of intervention into four parts or sometimes into five also.
19
Formulate the question with PICO. Sometimes PICO can be expanded to include T which stands
for Time or Type of study, in such situation it is known as PICO (T).
E.g,
P – Palliative care patients
I – Pain diary
C – No comparison or other pain history methods
O – Improvement in pain control
Constructing a PICO for a given clinical scenario improves the usefulness of questions to find a
correct answer.
20
Exercises:
Construct PICO for the following scenarios.
1. Does hand washing among healthcare workers reduce hospital acquired infections?
2. What is the effectiveness of restraints in reducing the occurrence of falls in patients 65 and
over?
3. "Is there evidence to suggest that the prophylactic use of vitamin B12 supplements is
effective in improving the quality of life (specifically cognition) of apparently healthy older
people?"
4. A friend of yours (Non Medical person) wants to discuss the possibility of a vasectomy. He
says he has heard something about vasectomy causing an increase in testicular cancer later in
life. You know that the risk of this is low but want to give him a more precise answer.
5. A 56 year old patient is osteoarthritis of right knee comes for Physiotherapy treatment.
Studies have shown that giving heating modality along with strengthening exercises improves
patient’s functional status faster than only strengthening exercises.
Once we converted our clinical scenario into a PICO format question, then the next step is to
use this PICO as keywords and search for the evidences. Evidences can be obtained as expert
opinions and also in text format from Text Books, Journals and also through Internet (search
engines, data bases) etc.
What is an Article?
Generally it is a piece of writing included in a magazine or newspaper. A scientific article is
written by scientists for a scholarly audience. A peer-reviewed journal article means that the
article's scientific quality has been checked by other scientists before publication.
21
What is Journal?
In academic publishing, a scientific journal is a periodical publication intended to further the
progress of science, usually by reporting new research.It is a scholarly publication containing
articles written by the researchers, professors and other expertise. Journals are likely to provide
more up-to-date information than books. Journals can also, in addition to scientific articles,
include other types of articles such as book reviews, opinion articles and commentaries.There
are many journals available in library both in Printed and electronic versions.
For e.g.: Journal of Orthopaedic & Sport Physical Therapy (JOSPT), Physical Therapy Journal, etc.
What is Reference?
Detailed description of the document from which you have obtained your information. For e.g.
reference given at the end of the book.
22
3. No ranking of results
4. Involve a learning curve
What is a database?
Database is an organized way of collection of data. Databases allow us to efficiently search for
published information such as journal, magazine, and newspaper articles. Databases can be
general (all disciplines) or discipline-specific (e.g. a physiotherapy database - PEDro). Since
databases are collection of scientific articles they are considered to give us relevant and reliable
answers to our questions. Some of the databases are
• Medline / PubMed
• CINAHL (Cumulative Index to Nursing and Allied Health Literature)
• PEDro
• TRIP database
• Cochrane library
• Uptodate
• Embase
• ProQuest
• Scopus
• EBSCO
When I should use a search engine and when I should use a database?
It depends on what type of information we are hoping to find and how we plan to use it. If we
want credible, scholarly articles, we will have more success finding relevant sources in a
database. If we want Census data, it is more efficient to find that through a search engine that
guides us to the appropriate government website.
Once we have a PICO (T) in our hand it is essential to decide which type of study we are looking
for and to decide the database that we will be using to search the evidence.
23
Step 3: APPRAISE the evidence
It is the process of systematically examining research to assess the value and trustworthiness of
the evidence. Once the evidence has been identified (article), it has to be assessed to know its
relevance to the original question, its quality etc. A health care professional should ask many
questions while appraising an evidence, keeping in their mind about the original question they
asked (the question that was converted into PICO format). Appraising the evidence has been
dealt in detail in the future sections in this book.
EBP does not stop at assessing the outcome of evidence. EBP is an ongoing process—
reassessing and re-measuring any gains or losses should be part of an ongoing cycle to ensure
the best outcomes.
24
Fig. EBP Process
Exercises:
1. Describe all the steps for searching an evidence on effect of resisted exercise on
improving strength of muscles.
2. Search for any two evidences on massage using all the steps.
25
Chapter – 5 INTRODUCTION TO RESEARCH DESIGN
What is Research?
Two syllables – Re and Search
Re – a prefix meaning again, anew or over again
Search – a verb meaning to examine closely and carefully, to test and try or to probe
Together Research is a Noun describing a careful, systematic, patient study and investigation in
some filed of knowledge, undertaken to establish facts or principles
Types of Research
Qualitative research: - Qualitative studies focus on subjects’ thoughts, perception,
opinions, beliefs and/or attitudes. Data are provided in words rather than in numbers
through interviews, surveys, diaries. E.g. Feedback for a particular instructor/teacher
from students.
26
Quantitative research: - Quantitative study is a formal, objective, systematic process in
which numerical data are used to obtain information. E.g. To analyse the intensity of the
pain one can use the following scale, which provides data in numeric form.
Research design
Quantitative Researches are structured means they require a study or research design.
Research design refers to the approach taken to answer a research question. A Research design
is a specific plan or protocol for conducting the study, which allows the investigator to translate
the conceptual hypothesis into an operational one.
27
Features of good design
Minimizes bias – reduces the possibilities of partial results.
Maximizes the reliability of the data collected – increases the Genuineness of the results
obtained.
The design which gives the smallest experimental error - providing maximum accuracy
with least uncertainty.
Yields maximal information - provides highest knowledge of all the aspects of that
particular study, like population chosen, treatment aspects, methodology, etc.
Observational study design: - Observational research is a study where researchers simply collect
data based on what is seen and infer based on data collected. Studies that do not involve any
intervention or experiment E.g. As mentioned in the earlier example, collecting data on how the
students rate their teacher on his/her performance. Another example is assessing the Lumbar
Lordosis and Lumbar Core Strength in Information Technology Professionals. In these type of
studies a researcher does not introduce any intervention and he/she just collects the data.
28
assessed before the commencement of study (baseline) and either at the end of study or during
the course of study to assess the differences in outcome, if there any.
1. Descriptive studies:
Case reports (Case study)
Case series
2. Analytical studies
Cross sectional survey
Case control
Cohort
E.g.
Case report: Physiotherapy strategies for a woman with symphysis pubis
diastasis occurring during labour.
Case report: the effect of physiotherapy and orthotic intervention, 40 years after
stroke
Robot assisted physiotherapy to support rehabilitation of facial paralysis
29
included. E.g. studying a clinical presentation of several patients with same diagnosis
and making a report describing all the cases.
In analytical study, the researcher has to use facts or information already available, and analyze
these to make a critical evaluation of the material. E.g. tobacco chewing causes oral cancer-
information already available. How many patients who chew tobacco have suffered from oral
cancer is analyzed.
E.g. If we want to assess the Risk factors for back pain in marines, a prospective cohort
study would be an ideal choice. We will enroll the eligible marines and assess their
baseline characteristics and follow up them for a defined period of time and reassess
them at the end of study about the occurrence of back pain.
30
Exposure Occupational hazards
Outcome Back pain
Population All eligible marines
Case-control study is a retrospective (looking back on/ dealing with past events)
research design used to evaluate the relationship between a potential exposure (e.g.
Risk factor) and an outcome (e.g. Disease). Two groups of subjects- one of which has the
outcome (the case) and one which does not (the control) are compared to determine
which group has a greater proportion of individuals with the exposure. E.g. Association
between smoking and lung cancer
31
Here the question investigated is the relationship between smoking and lung cancer.
Lung cancer takes years to develop so it was impractical to wait and see what happens
once someone started smoking. Instead researchers identified subjects diagnosed with
lung cancer and subjects free from disease and worked retrospectively to determine
each individual’s exposure to smoking. Results from the study provided enough
convincing evidence to conclude that smoking was a causal factor in causing cancer.
Another example is to find the association between Vitamin D deficiency and Chronic low back
pain
Risk factor Vitamin D deficiency
Outcome Chronic low back pain
Case People with low back pain
Control People without low back pain
In a Non RCT, the researcher decides / controls on allocation of group to a participating subject
whereas in a RCT the researcher does not have any such control.
32
Randomised controlled trial is a type of Study design where treatments, interventions,
or enrolment into different study groups are assigned by randomization.
Randomization can be done very simply by tossing a coin, by computer generated
random number or by using a random table. Randomization can also be done by lottery
method.
The randomised controlled trial is the most appropriate research design to evaluate the
effectiveness of an intervention. A study in which 1) There are two groups, one
treatment group and one control group. The treatment group receives the treatment
under investigation, and the control group receives either no treatment or standard
treatment. 2) Patients are randomly assigned to either one of the groups.
In the previous example of total knee replacement, the patients are grouped in to two. One
group t receive hospital OPD based physiotherapy treatment / rehabilitation (control) and other
group to receive home based rehabilitation program (experimental). In a RCT, the researcher
does not have any control over subjects’ allotment to any one of the group.
33
Advantages of RCT
Disadvantages
Compliance
Expensive
34
Large trials (may affect statistical power)
Though RCT is considered as gold standard, no other design is considered as less effective and
the Choice of research designs depends on:
Research Questions
Research Goals
Time and cost constraints
Exercises:
Give one example of research.
• To study whether home based nursing intervention for infant irritability reduces the
parenting stress or not
• To study whether any relationship between pain and functional disability in older
patients
Discuss the difference between qualitative and quantitative research and give example for
each.
Discuss the difference between cohort and case control study and give example for each.
35
Chapter – 6 LEVELS OF EVIDENCE
A number of research designs are given in previous chapter. One should anticipate the
differences of each research design when planning their search strategies in order to increase
the efficiency of the process. The selection process may be eased somewhat by ranking
research designs based on their ability to minimize bias. Proponents of evidence based
medicine have attempted to make the study selection process easier by developing hierarchies
or level of evidence. In 2006, Melynk, B.M. designed pyramid of level of evidence.
• Level VII. Evidence from opinion of authorities and/or reports of expert committees.
• Level VI. Evidence from a single descriptive or qualitative study.
• Level V. Evidence from descriptive and qualitative studies.
• Level IV. Evidence from well-designed case-control and cohort studies.
• Level III. Evidence obtained from well-designed controlled trials without randomization
(quasi-experimental).
36
• Level II. Evidence obtained from at least one well-designed RCT.
• Level I. Evidence obtained from a systematic review or meta-analysis of all relevant,
randomized clinical trials (RCTs), or clinical practice guidelines based on systematic
reviews of RCTs.
Here expert opinion is the lowest level of evidence (level VII). Professional who has acquired
knowledge and skills through study and practice over the years, in a particular field or subject,
to the extent that his or her opinion may be helpful in fact finding, problem solving, or
understanding of a situation.
Different types of research designs included from level VI to level II are described in previous
chapter where level II describes randomized controlled trial which is considered to be the “gold
standard” in research. Beyond that, there is one higher level of evidence (level I) i.e. systematic
review and Meta-analysis.
Systematic Reviews
Systematic review is a summary of the medical literature that uses precise methods to
systematically search, critically appraise and synthesize the literature on a specific issue. A
systematic review is a comprehensive survey of a topic.
Systematic review takes great care to find all relevant studies of the highest level of evidence,
Published and unpublished. It assesses each study, in explicit and reproducible way and
presented in a balanced and impartial summary of the findings. E.g. collect all the RCTs done on
different exercises in osteoarthritis. Select the best matching studies, based on our research
question. Critically appraise those articles and synthesize all studies to see effectiveness of
different exercises used for osteoarthritis.
Meta-Analyses
Meta-analysis is a systematic, objective way to combine data from studies in a systematic
review. The advantage to merging these data is that it increases sample size and allows for
analyses that would not otherwise be possible.
37
The difference between a systematic review and a meta-analysis is that a systematic review
looks at the whole picture (qualitative view), while a meta-analysis looks for the specific
statistical picture (quantitative view). E.g. 10 studies are included in systematic review on effect
of exercises in OA knee. Each study consist 100 patients. So you take all 1000 patients’ data and
analyze them statistically and find the result on effectiveness of exercises in OA knee.
Exercise:
1. Give one example of situation where you asked for expert opinion in your life.
38
Chapter – 7 STATISTICS
Open a newspaper and start looking for examples of articles and stories involving numbers. It
doesn't take long before numbers begin to pile up. Readers are inundated with results of
studies, announcements of breakthroughs, statistical reports, forecasts, projections, charts,
graphs, and summaries. The extent to which statistics occur in the media is mind-boggling. In
today's numbers explosion, the buzzword is data, as in, "Do you have any data to support your
claim?" "What data do you have on this?" "The data supported the original hypothesis that …",
"Statistical data show that …", and "The data bear this out ….". But the field of statistics is not
just about data. Statistics is the entire process involved in gathering evidence to answer
questions about the world, in cases where that evidence happens to be numerical data.
Statistics is concerned with the scientific method by which information is collected, organised,
analysed and interpreted for the purpose of description and decision making.
39
Descriptive statistics are used to describe the basic features of the data in a study. Descriptive
Statistics are used to present quantitative descriptions in a manageable form. In a research
study we may have lots of measures. Or we may measure a large number of people on any
measure. Descriptive statistics help us to simplify large amounts of data in a sensible way. Each
descriptive statistic reduces lots of data into a simpler summary. Together with tables and
simple graphics analysis, they form the basis of virtually every quantitative analysis of data.
What is data?
Data can be defined as a collection of facts or information from which conclusions may be
drawn.
Eg. Height and weight of every individual in a class.
Types of data A variate or random variable is a quantity or attribute whose value may vary from
one unit of investigation to another. For example, the units might be headache sufferers and
the variate might be the time between taking an aspirin and the headache ceasing. An
observation or response is the value taken by a variate for some given unit. There are various
types of variate.
Qualitative data is a categorical measurement expressed not in terms of numbers, but rather by
means of a natural language description.
40
Eg. Sizes (small, medium and large), levels of agreement (agree, somewhat agree, disagree) etc
Descriptive statistics are used to describe the basic features of the data in a study. It is just a
description of what data shows.
Displaying data
It is nearly always useful to use graphical methods to illustrate data.
Discrete data: frequency table and bar chart
Continuous data: histograms
41
Measures of location
By a measure of location we mean a value which typifies the numerical level of a set of
observations. (It is sometimes called a "central value", though this can be a misleading name.)
We shall look at three measures of location and then discuss their relative merits
Mean
Mean is the average value of a set of numbers. The mean is calculated by adding up all the
values, and then diving that sum by the number of values. E.g. The test score of seven students
are 98, 96, 96, 84, 80, 80, 72. So, the mean score of all seven students is 87.
[(98+96+96+84+80+80+72)/7 = 609/ 7=87]
Median
The median is the middle value in a set of values. To find the median, order the numbers from
largest to smallest or vice versa, and then choose the value in the middle. E.g. 1, 4, 3, 6, 2, 7, 5.
First arrange them in order, i.e. 7, 6, 5, 4, 3, 2, 1 and select the middle value i.e. 4. So the
median is 4.
If you have even number of observation, then median is calculated as follow. E.g. 1, 2, 3, 4, 5, 6.
Both 3 and 4 are in middle. Take average of those values, (3+4)/3=3.5 is the median.
42
Mode
The mode of a observation is the value or values that occur most frequently. There can be more
than one mode of a set. E.g. 10, 10, 4, 12, 10, 13, 12, 14. Here, 10 is the frequently occurring
observation so, 10 is the mode.
Let’s take another Example, 10,10,3,6,8,10,8,8. Here 8 and 10 both are occurring three times so
both are modes.
The dispersion
It refers to the spread of the values around central tendency.
Range
It is the variation between upper and lower limits of a scale. E.g. the score of a class test of all
students vary from 60 to 90 marks. Range is highest value minus lowest value. E.g. 15, 28, 31,
35, 27, 36. Here, highest value is 36 and lowest value is 15 so range is 36-15=21
Standard deviation (SD)
The standard deviation is the average distance between each data point and the mean. SD gives
a more complete picture of the distribution of elements in a data set. A low standard deviation
means that most of the numbers are very close to the average. A high standard deviation
means that the numbers are spread out. SD is calculated with following formula:
Where X represents each value in the population, M is the mean value of the population, Σ is
the summation (or total), and n is the number of values in the population.
For example values are 6,2,5,3. Mean is 4. The first data point is 6 and the mean is 4, so the
distance between them is 2. Squaring this distance gives us 4.
X=6, M=4, n=4, SD= 1
Exercises:
1. Find out the mean, median, mode, range and standard deviation for following data
20, 25, 21, 20, 23, 22, 24.
43
Chapter – 8 THE COCHRANE COLLABORATION
The Cochrane reviews database contains systematic reviews and Meta-analyses. Their work is
recognized as representing an international gold standard for high quality, trusted information.
The mission of Cochrane collaboration is to provide accessible, credible information to support
informed decision-making has never been more important or useful for improving global
health.
44
Chapter – 9 OUTCOME MEASURES
45
A key feature of an outcome measure is that it should demonstrate both validity and reliability
and be sensitive to the change(s) required to be measured as the change(s) occur(s) over time.
Reliability
The reliability of an outcome measure is concerned with how effectively the assessment can be
repeated when it is employed by different individuals and on different occasions.
E.g. ROM of elbow joint is measured with goniometer by two different therapists or measured
by same therapist at different time gives same result.
Test retest reliability: It may be established when an instrument is used on two separate
occasion with the same subject.
E.g. ROM of elbow joint is measured with goniometer by same therapist at different
time gives same result.
Instrument reliability: Internal consistency: is a form of reliability that is relevant to self-
report instruments, such as health related quality of life questionnaires. These surveys
usually have several items or questions, groups of which are designed to measure
different concept or constructs within the instrument.
Instrument reliability: parallel forms: This can be established only in cases where two
versions of instrument exist, both of which measure the same constructs or concepts.
E.g. Will Tape measure A give the same height measurement as tape measure B?
Instrument reliability: split half: It eliminates the need for two test administrations by
combining the two forms of an instrument into one longer version. Subjects complete
the entire instrument and then investigators separate the items for comparison to
determine the degree to which scores agree for the same items or concepts. E.g. A test
is split into two, odds and evens, if the two scores for the two tests are similar then the
test is reliable.
Intra rater reliability: The consistency of repeated measure performed by one individual
is referred as intra rater reliability. E.g. Therapist measuring ROM should be able to
obtain nearly the same score for the same position each time the measure is taken.
46
Inter rater reliability: The consistency of repeated measure performed by several
individuals is referred as inter rater reliability. E.g. several therapists from same clinic
measuring ROM of same patient give consistent score.
Validity
The validity of an outcome measure is the ability of measure what is intended to measure. E.g.
A goniometer measures joint position in degrees is valid instrument for ROM whereas
thermometer is not.
Face validity: is tested with the question, “Does this instrument appear to be the
appropriate choice to measure this variable?” this is a “yes-no” question. E.g. is
goniometer appropriate to measure ROM?
Content validity: an instrument is said to have content validity when it represents all the
relevant facets of the variable it is intended to measure. E.g. A questionnaire to know
the effect of disease or disorder on lower extremity function should contain item that
address the performance of the entire leg (not about the upper extremity function).
Construct validity: construct validity defines how well a test or experiment measures the
construct. It refers to whether the operational definition of a variable actually reflects
the true theoretical meaning of a concept. E.g. Doctor testing the effectiveness of
painkillers on back pain. The subject is asked to rate the pain level out of ten. In this
case, construct validity would test whether the doctor actually was measuring pain and
not numbness, discomfort or anxiety.
Criterion validity: the criterion validity of an instrument reflects the degree to which its
scores are related to score obtained with a reference standard instrument. E.g.
comparison between the results of a clinical examination technique and MRI to detect
soft tissue damage. The MRI is the superior test because of its ability to capture images
of the affected tissue. The clinical examination technique will have high criterion validity
if it produces the same results as the MRI.
47
Sensitivity
The sensitivity of an outcome measure is its ability to detect subtle changes in a patient’s
progress when measured over a specific period of time. E.g. Goniometer is able to measure the
smallest change that occurs in a range.
Exercises:
1. Give two examples of outcome measure used in physiotherapy.
2. Explain reliability and validity using one example of outcome measure.
3. Discuss the difference between intra-rater and inter-rater reliability.
48
References:
Herbert & Jamtvedt: Practical Evidence Based Physiotherapy, 2nd Edition.
Stillwell, Susan B. et al, evidence based practice, step by step: searching for the
evidence, Americal Journal of Nursing, May 2010, vol.110.
Dianne V. Jewell: Guide to Evidence-Based Physical Therapy Practice.
K. Park & Park: park’s textbook of preventive and social medicine: 23rd edition.
C. R. Kothari: Research Methodology, second revised edition.
Glover, Jan; Izzo, David; Odato, Karen & Lei Wang. EBM pyramid. Dartmouth
University/Yale University. 2006.
Dianne V. Jewell: Guide to Evidence-Based Physical Therapy Practice.
www.cochrane.org.
National Council for Osteopathic Research 2012.
Steven Sadowsky, Ellen Hillegas, essentials of cardiopulmonary physical therapy.
Priscilla Velentgas, et al, Developing an Observational CER protocol: A user’s guide,
chapter 6: outcome definition and measurement.
http://cosmologist.info/teaching/STAT/CHAP4.pdf
Grinnell, Richard Jr (eds), 1993, Social Work Research and Evaluation (4th edn), Itasca,
IL, F.E. Peacock.
49
Chapter – 10 CRITICAL APPRAISAL
Critical appraisal is the process of carefully and systematically examining research to judge its
trustworthiness, and its value and relevance in a particular context.E.g., An Article suggesting
Physiotherapyto be beneficial in one of the Musculoskeletal Condition is critically appraised to
check its trustworthiness and its value for that particular condition.
50
Not difficult to develop skills
51
Fig: Area highlighted shows Purpose of the study
52
Critical analysis of a Case Series
Fig: Area highlighted shows Title of the Article along with the Abstract
53
Fig: Area highlighted shows Purpose of the study
54
Fig: Area highlighted shows Inclusion and Exclusion Criteria
55
Fig: Area highlighted shows Outcome of the study
56
Fig: Area highlighted shows Authors Conclusion in the Article
57
3. Critical appraisal of Cross Sectional Study:
58
Fig: Area highlighted shows Purpose of the study
Fig: Area highlighted shows Study Design along with Inclusion and few of the Exclusion Criteria
59
Fig: Area highlighted shows Method of Data Collection
60
Fig: Area highlighted shows Outcome Measures
61
Fig: Area highlighted shows Statistical Analysis in the Article
62
Fig: Area highlighted shows Authors Conclusion in the Article
63
4. Critical Analysis of Case Control Study
Fig: Area highlighted shows Title of the Article along with the Abstract
64
Fig: Area highlighted shows Purpose of the study
65
Fig: Area highlighted shows Inclusion Criteria
66
Fig: Area highlighted shows Study Design and Method of Data Collection
67
Fig: Area highlighted shows Statistical Analysis in the Article
68
5. Critical Appraisal of Retrospective Cohort study
69
Fig: Area highlighted shows Purpose of the study
70
Fig: Area highlighted shows Inclusion and Exclusion Criteria
71
Fig: Area highlighted shows Statistical Analysis in the Article
72
6. Critical appraisal of Randomized Controlled Trial
73
Fig shows Title of the Article along with general Details and Abstract
74
Fig: Area highlighted shows study design
75
Fig: Area highlighted shows Statistical Analysis
76
Scoring system
Quality Scoring
Good / very good ≥80 and <100
Fair 55-79
Not acceptable <55
If the Score is below 55 than the article is of not much importance and validity
(5 different studies of different types should be added for appraisal)
77
Chapter – 11 COMMUNICATINGEVIDENCE TO CLIENTS, MANAGERS AND
FUNDERS
An effective communication regarding evidence is one in which a message has not only been
sent but also received, understood, and act upon- known as knowledge utilization,making
communication bridge between client and therapist.For example the ergonomic advice given by
therapist to an Osteoarthritis knee patient to avoid cross leg sitting, squatting and stair climbing
as being received, understood, and acted upon by the patient in proper sense.
2. Identify the decisions that decision maker will be involved in making with the therapist
3. Gather and interpret research evidence that is guided by the information needs of decision
maker and the clinical population of interest
78
4. Translate the evidence into a comprehensible communication to facilitate an informed
discussion with the decision maker.
Decision maker Decision makers use of Questions that guide search for
evidence evidence
Client (OA Knee Patient for To make informed decisions What is the most effective and
Participating in Program) about participating in feasible physical therapy
and Family Members intervention procedures intervention for achieving
(Regarding benefits of the participation in successful and safe
Patient participating in the Aerobic Exercise program among
program) 40 to 70 years old men and
women with Osteoarthritis knee?
Manager To decided which intervention What is the most effective and
procedures would be feasible physical therapy
supported and provided by intervention for achieving
the organization personally meaningful goals
among person with Osteoarthritis
knee?
Funder To decide whether or not the Same Question as for Manager
predicted level of
Effectiveness and feasibility of
a clinical intervention program
is worth funding
Exercise:
How you would communicate evidences to the Patient, Family Members and the
Managers in five different Conditions.
79
Chapter – 12 INFERENTIAL STATISTICS
A “P value” is the probability of obtaining the observed effect (or larger) under a ‘null
hypothesis’, which in the context of Cochrane reviews is either an assumption of ‘no effect of
the intervention’ or ‘no differences in the effect of intervention between studies’ (no
heterogeneity).
P-values in scientific studies are used to determine whether a null hypothesis formulated
before the performance of the study is to be accepted or rejected. In exploratory studies, p-
values enable the recognition of any statistically noteworthy findings.
‘2Thus, a P value that is very small indicates that the observed effect is very unlikely to have
arisen purely by chance, and therefore provides evidence against the null hypothesis.
It has been common practice to interpret a P value by examining whether it is smaller than
particular threshold values. In particular, P values less than 0.05 are often reported as
“statistically significant”, and interpreted as being small enough to justify rejection of the null
hypothesis. (EGS to be added)
Confidence Interval
The confidence interval is a range of values calculated by statistical methods which includes the
desired true parameter (for example, the arithmetic mean, the difference between two means,
the odds ratio etc.) with a probability defined in advance (coverage probability, confidence
probability, or confidence level).
The confidence level of 95% is usually selected. This means that the confidence interval covers
the true value in 95 of 100 studies performed. The advantage of confidence limits in
comparison with p-values is that they reflect the results at the level of data measurement.
80
Relative Risk (RR)
Relative risk measures the magnitude of an association between an exposed and non-exposed
group. It describes the likelihood of developing disease in an exposed group compared to a
non-exposed group.
Relative risk is calculated using cumulative incidence data to measure the probability of
developing disease. Therefore, relative risk can only be calculated if the study was designed in
such a way that incidence data can be calculated. For example, study designs such as cohort
studies and clinical trials allow the researcher to calculate incidence, whereas case-control
studies do not. Thus, relative risk can be calculated for cohort studies and clinical trials, but not
for case-control studies.Odds ratios can be used to estimate relative risk for a case-control
study.
Relative risk can be calculated from a 2x2 table using the following formula:
81
For Example:
An odds ratio (OR) is a measure of association between an exposure and an outcome. The OR
represents the odds that an outcome will occur given a particular exposure, compared to the
odds of the outcome occurring in the absence of that exposure. Odds ratios are most
commonly used in case-control studies.
Odds ratios are used to compare the relative odds of the occurrence of the outcome of interest
(e.g. disease or disorder), given exposure to the variable of interest (e.g. health characteristic,
aspect of medical history). The odds ratio can also be used to determine whether a particular
exposure is a risk factor for a particular outcome, and to compare the magnitude of various risk
factors for that outcome.
82
We will Calculate ODDs Ratio (OR) using a 2x2 frequency table
Outcome Status
+ -
+ a b
Exposure status
- c d
For Example:
83
Odd Ratio=ad/bc= 33 × 27/55 × 2=8.1
i.e. Cigarette Smokers have 8.1 times of developing Lung Cancer compared to Non Cigarette
Smokers
84
Chapter – 13 ECONOMIC EVALUATION
Economic evaluation is defined as “the systematic appraisal of costs and benefits of projects,
normally undertaken to determine the relative economic efficiency of programs.”
85
Types of Economic Evaluation and Decision Levels
There are two levels of economic evaluation: partial and full. Partial economic evaluation
measures program or disease costs, but does not involve a comparison with alternative options
and does not relate costs to outcomes. Partial economic evaluations include cost-of-illness
analysis and program cost analysis. For example the estimate of cost by the Health care
ministry for the treatment of Polio disease. In public health, full economic evaluation compares
two or more public health interventions through the examination of costs of inputs and
outcomes. Full economic evaluations include cost-benefit, cost-effectiveness, and cost-utility
analyses. For Example for the treatment of Low Back Pain, Conservative treatment in form of
Ergonomic Advices, Pharmacological Drugs and Physical Therapy is beneficial compared
toSpinal Surgery and would increase the functional performance of Patients and along with
work output.
To carry out Economic Evaluation, the researchers should have definite problem and objectives
for research, need to identify the alternatives and describe each alternative, identifying
whether financial or economic data will be collected, collecting background data (on salaries,
inflation, discount rates) from the Ministry of Health, the Ministry of Finance or other Central
Economic Planning and Statistical Offices; identifying the different types of cost data that are
needed, and collecting these data from the program or project. Ideally, the ultimate indicator of
public health impact would reflect the impact on morbidity and mortality as a result of the
intervention. Ultimately the statistical Analysis would be carried out and finally the Economic
Evaluation is used in Decision Making post Critical Analysis.
86