National Institute of Management

An Examination of Institutional Evaluation

Systems and Suggestions for their
Improvements

Dr. Allah Bakhsh Malik PhD

February 21st 2010

February 22nd 2010 Institutional Evaluation 1

 Introduction
9 Examination of Institutional Evaluation System:
Epistemology Accreditation Baseline Law Rules
and Regulations
9 Determinants of Institutional Evaluation
9 Institutional Legacy and Development of
Institutions
9 Constitution of Pakistan and Institutional
Development

February 22nd 2010 Institutional Evaluation 2

 Introduction
9 Processes of Institutional Evaluation: Conception,
Feasibility, Piloting, Formative and Summative
Evaluation
9 Requisites of Institutional Development
9 Continuous Improvement of Institutions and
Institutional Arrangements
9 Purpose of Institutional Arrangements
9 Institutional DNA and longevity

February 22nd 2010 Institutional Evaluation 3

 Pakistani Perspective
• UNDP Human Development Report 2009 ranked Pakistan 134
out of 177 countries in terms of the human development index
(HDI)
• Pakistan’s ranking among the 177 countries last year was 135.
• Life expectancy in Pakistan was 63.4 years, giving it the 123rd
position, while the adult literacy rate was 49.9 percent, giving it
the 116th position.
• Pakistan was ranked 124 in terms of GDP per capita.
• Pakistan’s human poverty index (HPI-1) is 36.3 percent, and it is
ranked 65 among 102 developing countries.

February 22nd 2010 Institutional Evaluation 4

 Pakistani Perspective
• Pakistan’s gender-related development index (GDI)
is 0.513.
• Out of the 136 countries that were evaluated for both
the HDI and GDI, Pakistan is ranked 133.
• The country’s public expenditure on health stood at
0.7 percent of gross domestic product and on
education at 2 percent of GDP.
• Its military expenditures were 3.4 percent of GDP
and debt servicing 4.5 percent of the GDP.

February 22nd 2010 Institutional Evaluation 5

 Pakistani Perspective
9 Pakistan is sixth most populous country with 160
million people.
9 Overall literacy rate is 54%, 36% for females.
9 Pakistan has 6.5 million children out of school and
80% of them never been enrolled in schools.
9 40% of enrolled children drop out before reaching
grade 4 and 77% of enrolled children drop out
while climbing ladder of grade X.
9 Pakistan is at serious risk of not attaining MDGs
and EFA targets by 2015
9 Poverty Line
9 FDI and Money Travel
February 22nd 2010 Institutional Evaluation 6
 Examination of Institutional Evaluation
System
Bloom's Taxonomy of Cognitive Levels
• Knowledge
• Comprehension
• Application
• Analysis
• Synthesis
• Evaluation

February 22nd 2010 Institutional Evaluation 7

 Examination of Institutional Evaluation
System
• Capacity Building and Professional Development
• Social Capital Formation
• Knowledge Societies
• Knowledge Management
• Knowledge Workers
• Technology and Electronic Superhighways

February 22nd 2010 Institutional Evaluation 8

Determinants of Institutional Evaluation

• Organization
• Structure
• Service Delivery
• Tiebout Allocative Efficiency
• Pareto Optimal Utilization
• Cost Benefit Analysis
• Value for Money

February 22nd 2010 Institutional Evaluation 9

 Institutional Legacy

• State Institutions on Independence

• Institutional Mechanism
• Discipline
• Command and Control
• Unitary Command
• Trickle Down Effects

February 22nd 2010 Institutional Evaluation 10

 Processes of Institutional Evaluation:

• Institutional Arrangement for Need Assessment

• Who determines the need?
• Who decides allocations?
• Conception
• Feasibility
• Piloting
• Formative and Summative Evaluation

February 22nd 2010 Institutional Evaluation 11

 Requisites of Institutional Development

• Governance
• Authority
• Responsibility
• Accountability
Authority + Responsibility – Accountability =
Corruption
Authority – Accountability = Corruption +
Informal Sector

February 22nd 2010 Institutional Evaluation 12

Continuous Improvement of Institutions
Institutional Arrangements

• Lessons Learnt Bleeding and Integrating into the

System
• Best Institutional Practices Indigenized
• Public Private Partnerships
• Synergy and Synchronization

February 22nd 2010 Institutional Evaluation 13

 Constitution of Pakistan and
Institutional Development
• Fundamental Rights
• Constitutional Offices
• Rules of Business

February 22nd 2010 Institutional Evaluation 14

 Institutional DNA and longevity

• Honesty
• Competency
• Impeccable Professional Integrity
• Cisco - Secure Service Delivery

February 22nd 2010 Institutional Evaluation 15

 Suggestions for Improvements

Economic policy reforms in many DCs concentrated on:

(i) achieving macroeconomic stability;
(ii) opening international trade;
(iii) achieving domestic deregulation and liberalization;
(iv) providing adequate regulatory and legal frameworks.

February 22nd 2010 Institutional Evaluation 16

 Suggestions for Improvements
Policy reforms aim at providing the private
sector with a favorable enabling
environment: greater efficiency will be
encouraged by a market-oriented system
that enhances incentives under increased
competition

February 22nd 2010 Institutional Evaluation 17

 Suggestions for Improvements

These new strategies imply a re-orientation

of many public agencies from a focus on
rigid and detailed control to that of
monitoring and support. These changes
suggest the elimination of some institutions
in the public sector; the restructuring of
others to operate in liberalized and more
competitive environments.

February 22nd 2010 Institutional Evaluation 18

 Suggestions for Improvements

• Given the inadequacy of current government

institutions, there is the risk that their
economic policy reforms will be undermined
over time. Institutional development is a key
element to consolidate and ensure the sound
implementation and sustainability of policy
reforms over time.

February 22nd 2010 Institutional Evaluation 19

 Suggestions for Improvements

• What should be the span of Institutional

Development work?
• How do we define it?

February 22nd 2010 Institutional Evaluation 20

 Suggestions for Improvements

The term institutional development has been

used by different people in different
contexts:
• At one extreme, a narrow definition equates
institutional development with the process of
strengthening individual government
organizations or entities.

February 22nd 2010 Institutional Evaluation 21

 Suggestions for Improvements

• At the other extreme, a broader view defines

institutional development to include
improvements in both public and private
organizations as well as in the rules,
regulations, practices, values, and customs
that shape and influence an entire society.

February 22nd 2010 Institutional Evaluation 22

 Suggestions for Improvements

• When a strong government institution is created,

it is often at the expense of other weaker ones.
• Creation of a strong "Project Unit" to overcome
the inefficiency or corruption of line and
regulatory agencies may enable it to get its job
done. It will also get in the way of attempts to
strengthen the regular line and regulatory
agencies.

February 22nd 2010 Institutional Evaluation 23

 Suggestions for Improvements

• A more sustainable work on "Institutional

Development" would be one which includes not
only the process of strengthening individual
government organizations but also the more
systemic efforts to create an improved
institutional environment for the public sector.
• Ultimately, institutional development goal should
be to improve the way a government works.

February 22nd 2010 Institutional Evaluation 24

 Suggestions for Improvements

• Incentives
• Competition
• Management
• Recognition
• Eminence and Erudition

February 22nd 2010 Institutional Evaluation 25

 Suggestions for Improvements

Public Private Partnership

February 22nd 2010 Institutional Evaluation 26

 Suggestions for Improvements

• Key Performance Indicators

• Defining Performance Indicators
• Measuring Indicators
• Monitoring Indicators
• Evaluation Indicators
• Analyzing Performance Indicators
• Synthesis Performance Indicators

February 22nd 2010 Institutional Evaluation 27

 Malaysian Development Model

A Successful Model Replicable

February 22nd 2010 Institutional Evaluation 28

 Exercise
• Police Department
• Education Department
• Revenue Department
• Excise and Taxation Department
• PIA
• Railways
• Daewoo

February 22nd 2010 Institutional Evaluation 29