Policy Evaluation
Policy evaluation is the systematic collection and analysis of information to make judgments
about contexts, activities, characteristics, or outcomes of one or more domain(s) of the
Policy Process.
OR
Policy evaluation can be better defined as a process by which general judgments about
quality, goal attainment, program effectiveness, impact, and costs can be determined.
Elected officials, policy makers, community leaders, bureaucrats, and the public want to
know what policies work and what policies don't.
The purpose of evaluation is to determine whether an implemented program is doing
what it is supposed to.
Through evaluation, we can determine whether a policy's effects are intended or
unintended and whether the results are positive or negative for the target population and
society as a whole.
Why policy evaluation is important?
It can help governments improve the design and implementation of public policies that, in
turn, can lead to prosperity for their country and well-being for citizens.
Policy evaluation contributes to promoting public accountability, learning and increased
public sector effectiveness through improved decision-making.
Evaluation provides a systematic method to study a program, practice, intervention, or
initiative to understand how well it achieves its goals. Evaluations help determine what
works well and what could be improved in a program or initiative.
Policy Evaluation in Pakistan
Why does Pakistan’s public policy-making face so many difficulties in
first designing the right policies and then sticking to them?
Public policy has been a problem since the establishment of Pakistan.
Good policy making is the way governments address the problems faced by the people
they are elected to serve. Pakistan has failed to evolve a mechanism for consistent
policy making and implementation.
According to the constitution of Pakistan, the Executive is responsible for the
development of public policies. After the 18th Amendment, policy making in several
areas including education, health and local government has been devolved to the
provinces. In reality, policy making since independence has been dominated by vested
interests.
There are many factors behind the general public policy failure in Pakistan. These
include corruption; insufficient or irrelevant financial allocations; incompetent human
resource; poor policy evaluation and monitoring systems; a lack of vision and a
centralized approach to implementation, weak institutional structures and frequent
interventions.
The most important factor is the policy-making team. Policymakers are sent to visit
other countries to learn from their experience.
But many of them formulate policies without fully appreciating the differences between
the circumstances of those countries and the local conditions.
Steps involved in policy evaluation
1. Clarify what is to be evaluated.
2. Engage stakeholders.
3. Determine your evaluation questions.
4. Develop an evaluation framework.
5. Determine appropriate methods of measurement and procedures.
6. Develop an evaluation plan.
7. Collect data.
8. Process data and analyze results.
9. Interpret and disseminate results.
10. Apply evaluation findings.
Methods of Policy Evaluation
1. Evaluating Policy Content: Does the content clearly articulate the goals of the policy,
its implementation and the underlying logic for why the policy will produce intended
change? Evaluating the development of a policy helps to understand the context,
content, and implementation.
2. Evaluating Policy Implementation: Was the policy implemented as intended? The
implementation of a policy is a critical component in understanding its effectiveness.
Evaluation of policy implementation can provide important information about the
barriers to and facilitators of implementation and a comparison between different
components or intensities of implementation.
3. Evaluating Policy Impact: Did the policy produce the intended outcomes and
impact? Within injury prevention, the intended impact may be a reduction in injuries
or severity of injuries. However, it is important to evaluate short-term and
intermediate outcomes as well.
Policy change
A major change in attitude or principle or point of view; "an about-face on foreign
policy" volte-face, about-face, reversal. change - the action of changing something;
"the change of government had no impact on the economy"
Example
Policy change includes policies at the legislative or organizational level. For example,
institutionalizing new rules or procedures as well as passing laws, ordinances,
resolutions, mandates, regulations, are all examples of policy change efforts.
Reasons for Policy Change
The legality or constitutionality of a policy is challenged.
Technological changes alter the feasibility or relevance. New discoveries or
revelations alter public support.
Economic and political conditions change.
Types of policy change
First-order change (routine adjustments to existing policies),
Second-order (changes in the policy instruments used to achieve shared goals), and
Third-order change (shifts in the goals themselves).