2016 6th International Conference on Information Technology for Manufacturing Systems (ITMS 2016)

ISBN: 978-1-60595-353-3

Under the Background of Smart City Development of E-Government

Performance Evaluation—Study in Every Districts of Beijing
Li-jun Wang
College of Econoomics & Management Beijing University of Technology, Beijing, China
Yu Zhang
Electronic Technology Information Research Institute, MIIT, Beijing, China
Qiang Li(Corresponding author)
Electronic Technology Information Research Institute, MIIT, Beijing, China
Ping-nan Ruan
College of Economics & Management Beijing University of Technology, Beijing, China

ABSTRACT: Under the background of smart city sweeping the global context, as a new public management
and an important part of reinventing government, the application of e-government information technology has
been regarded as one of the main source for government change and innovation. Based on e-government-
related cross-sectional data of every districts in Beijing, this paper uses data envelopment analysis (DEA) to
carry out performance studies, which found the government in terms of e-government input and output
problems and make recommendations accordingly, in order to reduce investment in information technology is
invalid, and further promote our long-term e-government, to provide a theoretical basis for orderly
development.

1 INTRODUCTION countries and developing countries, there is a

With internet of things, the next generation internet,
cloud computing and other new round of IT change
accelerating and deepening of applications, urban
construction there has been new development model,
"smart city" as the most innovative urban form is
gaining social wide response. Under this
background, e-government as an important part of
the new public management movement and
remodeling government, it has been regarded as one
of the main sources of government reform and
innovation.
At present, all levels of government in our
country are actively developing e-government,
constantly enrich the means of governance,
innovation and management mode, improve the
institutional mechanisms, and has made considerable
progress. However, it is worth noting that, although
many countries in the process of promoting the
electronic government to continue to join
investment, and promote the construction of a large
number of government projects, but from a global
point of view, the effectiveness of e-government
construction is not ideal. In 2003 the United Nations
in the "at the crossroads of e-government" Research
Report in particular stressed that both developed
328
widespread phenomenon of e-government overall
efficiency, and developing countries is particularly
prominent, the failure rate of its projects up to
60%~80%. This is also a great concern in the
construction of E-government in our country, the
electronic government application system
construction project investment returns vary greatly,
and with the financial constraints of hardening and
transparency of information disclosure, the cost of
failure is not only the project itself, but also includes
the public trust and support of the government. The
Robert Solow (insulating) puts forward "it
productivity paradox" coincide: Although the
enterprise in it put a lot of resources, however, from
the point of view of productivity, unrewarding, put
large amounts of information into a "black hole".
Therefore, in order to find out and solve the
problems in the process of e-government
construction, the quantitative research on the
performance of e-government is carried out in a
timely manner.
Based on the data of 16 counties in Beijing City,
this paper uses the data envelopment analysis (DEA)
to carry out the performance research, and finds the
problems of government investment and output in e-
government, and puts forward the corresponding
suggestions.
2 RESEARCH FOUNDATION
At present, the organization of e-government
performance research is mainly concentrated in the
government think tank, consulting company and
scientific research institutions, and its research can
be divided into three levels:
The first level of the assessment of research
objects are concentrated in the direct "Output",
including the government website construction,
information system construction, personnel training
and other e-government infrastructure and software
and hardware construction, etc., is usually assessed
in the construction of e-government. Such as the
United Nations of the electronic level of readiness
assessment includes three aspects: the status of the
government website, basic facilities, human
resources. IBM e-government research institute also
from the perspective of e-government infrastructure,
a flexible, scalable and reliability of the three
categories of technical assessment criteria. Domestic
researchers, such as CCID Consulting Company,
firm CCW, China Software Testing Center, more
concentrated in the level of output. Such as the
China Software Evaluation Center sponsored by the
Chinese government website performance
evaluation, mainly to assess the integrity of the
government website content and category, and
joined a small part of the service effectiveness and
user survey ingredients.
The second level is the study of the electronic
government application "results (Outcome)"
assessment, performance in the electronic
government application efficiency (Efficiency),
Economical (Effectiveness) and other aspects of
attention. Joan reference model of electronic
commerce and e-government website service
efficiency performance model was established,
including six indexes: efficiency of promotion
(awareness), popular (popularity) efficiency, content
(content) efficiency, conversion (conversion)
efficiency and maintain (1905) efficiency, use the
site visits, ranking, amount of content, service
people inferior data on performance were
quantitative analysis. Gupta and Lili Wang et al.
From the perspective of the tangible and intangible
value of e-government projects, and the accessibility
of information, the evaluation model is established,
which mainly includes the navigation, access
channel, running time, customization ability and
service efficiency of the e-government project.
The third level is concerned with the "Impact",
the study of E-government in social benefits,
fairness, government trust, citizen satisfaction and
performance of government responsibility and
329
response. This kind of research is based on a wide
range of social surveys. E-government effectiveness
assessment such as Gartner consulting company
includes three aspects of the level of service for
citizens, operational effectiveness and political
returns, and each aspect of a number of specific
indicators, such as service maturity, service
availability, the number of services provided and the
impact on line services, etc. OECD also proposed
the "good governance" as the guidance of e-
government performance evaluation criteria,
including legal, legal, transparency, efficiency,
participation, and so on seven aspects. Because of
the questionnaire and data acquisition and other
reasons, the domestic use of the questionnaire survey
conducted by the electronic government performance
evaluation, the majority of the evaluation criteria and
evaluation index design.
3 STUDY ON THE PERFORMANCE
EVALUATION OF E-GOVERNMENT IN
BEIJING
In this paper, the data envelopment analysis (DEA)
method is used to evaluate the performance of E-
government in 16 counties in Beijing. Its
characteristic is: this method is from the angle of the
most benefit to be judged to carry on the relative
effectiveness evaluation, it reflects the respect for
the modern evaluation idea of the value of the
object. And from the actual service content of e-
government, reasonable increase in the input and
output indicators, DEA effective evaluation unit
increased, more value is recognized, the
improvement of the non DEA effective unit tends to
be easier.
3.1 The establishment of performance evaluation
index of E-government
For the evaluation of e-government performance, the
main focus on the public satisfaction, the cost of e-
government construction projects, the management
of the operation and management of social benefits
and social benefits. This paper from the actual
service content of the e-government, reasonable
increase input and output indicators, from the input -
output point of view, the 16 counties of Beijing e-
government performance evaluation. In particular,
the main consideration of the investment, financial
(industry) and technology input, select the local
government spending, information services,
information service industry practitioners accounted
for four of the new technology application index;
Output focus reflected in the comprehensive benefits
of society, selection of information disclosure,
interaction, open education, social security,
employment, health care, housing, marriage,
adoption, utilities, enterprise, business tax and 2013 national government website performance
investment services index. evaluation report.
3.3 Analysis based on Data Envelopment Analysis
Table 1. The evaluation index system of
(DEA)
E-government Performance Based on DEA.
First Second stage Third stage method
level index 3.3.1 Study on the performance of the government
indicator investment in the districts
Input Fund Local government In this paper, the Matlab software is used to solve
(industry) expenditure the multiple linear programming, and the relative
investment The proportion of efficiency value of the decision unit DMU i is
Information service calculated, and the weak efficiency is analyzed.
industry The relative efficiency value of the decision
Human The Proportion of making unit is at least a weak DEA effective, by the
resource employees of
investment Information service model's judgment criterion.
industry E=
Technical New technology Columns 1 through 8
input application index 1.0000 0.9561 1.0000 0.6226
Output Government Information disclosure 1.0000 1.0000 1.0000 1.0000
information index Columns 9 through 16
disclosure
Service ability Education service index 0.8553 1.0000 1.0000 1.0000
Social security service 1.0000 1.0000 1.0000 1.0000
index Among them, the relative efficiency of1
Employment service (Dongcheng), 3 (Chaoyang), 5 (Fengtai), 6
index (Shijingshan), 7 (Mentougou), 8 (Fangshan), 10 （
Medical service index
Housing service index
Shunyi ） ,11 (Daxing), 12 (Changping), 14
Marriage adoption index (Huairou), 15 (Miyun), 16 (Yanqing), 13
Utility index (Pinggu)was 1.
Document handling For the 13 relative efficiency of the decision
index making units, in order to further determine the DEA
Business start-up index effectiveness of the decision making unit, a linear
Operating tax index
Investment index
programming model is adopted( Dε )
Public Interactive exchange theta =
participation index Columns 1 through 8
1.0004 0.9561 1.0002 0.6226
1.0000 1.0000 1.0000 1.0000
3.2 Sample and sample data selection Columns 9 through 16
According to the above analysis, the performance 0.8553 1.0000 1.0000 1.0000
evaluation index system of E-government 1.0002 1.0000 1.0000 1.0000
These 13 weak effective decision units are
Performance Based on DEA is established, and the
overall effectiveness analysis and projection analysis satisfied θ ∗=1 =
and s ∗+ s ∗−=0, they are DEA
of the production frontier are carried out respectively effective. By analyzing the value of the relative
in 16 districts of Beijing, thus for the healthy effectiveness of θ ∗ can be seen, 16 districts of
development of E-government in government Beijing in the region of the 0.6-1, the overall
departments provide guidance and advice, to make it effectiveness of Beijing City e-government, more
in the upcoming "45" planning, project information than 80% of the county's e-government input and
construction, give full consideration to the output to achieve a better configuration.
characteristics of its actual situation and It can be seen from the analysis of the value of
development, so that the performance of their duties s − and s + (See Table 2). s − show 1 (Dongcheng), 3
the effectiveness of greater ascension. (Chaoyang), 4 (Haidian), 5 (Fengtai), 8 (Fangshan),
Sample data are mainly derived from the 10(Shunyi),11 (Daxing), 12 (Changping), 13 (Pinggu
statistical yearbook of Beijing City, and the public t) and other counties in the local government
publication of the Research Report. Among them, financial expenditure is put into the problem of
the input index of local government spending, redundancy;2 (Xicheng), 4 (Haidian), 9 (Tongzhou)
information services, information service industry in the information service industry, there is a
practitioners accounted for more than the original problem of investment redundancy;4 (Haidian) in
data were derived from the county's 2013 statistical the information service +industry has put into the
yearbook, the new technology application index and problem of redundancy; s can see the DEA invalid
output indicators are derived from the report of the decision making unit 2 (Xicheng District), 4
330
(Haidian District), 9 (Tongzhou District) are the
problem of insufficient output. Among them, the
lack of output mainly in the areas of information
disclosure, public interaction, medical care, housing
and marriage adoption etc..For these DEA invalid
counties, the current resource investment can not
even be appropriate to reduce the situation, increase
public service output; Or in the case of maintaining
the current output of services, the amount of
investment in the electronic government.
− +
Table 2. s , s and theta values of the districts
and counties of Beijing.
______________________________________________
DMU 1 2 3 4 5 6 7 8
______________________________________________
theta 1.0 1.0 1.0 0.6 1.0 1.0 1.0 1.0
______________________________________________
S- 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.0
680.9 0.0 635.2 77.5 53.7 0.0 0.0 4.2
0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
______________________________________________
S+ 0.0 0.5 0.0 0.0 0.0 0.0 0.0 0.0
0.0 0.2 0.0 0.1 0.0 0.0 0.0 0.0
0.0 0.2 0.0 0.0 0.0 0.0 0.0 0.0
0.0 0.1 0.0 0.0 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.0
0.0 0.2 0.0 0.1 0.0 0.0 0.0 0.0
0.0 0.2 0.0 0.0 0.0 0.0 0.0 0.0
0.0 0.3 0.0 0.0 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.0 0.5 0.0 0.2 0.0 0.0 0.0 0.0
_____________________________________________
______________________________________________
DMU 9 10 11 12 13 14 15 16
______________________________________________
theta 0.9 1.0 1.0 1.0 1.0 1.0 1.0 1.0
______________________________________________
S- 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.0 91.8 76.8 13.9 139.9 0.0 0.0 0.0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
______________________________________________
S+ 0.0 0.5 0.0 0.0 0.0 0.0 0.0 0.0
0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
______________________________________________
It is worth noting that, in the DEA null and void
of the county, the Xicheng District e-government
development level among the city's second, Haidian
District ranked fourth; In 2013, the Chinese
government website performance evaluation,
Xicheng District ranked second (first in the city),
Haidian District ranked thirty-seventh (eighth in the
city). This shows that although the level of e-
government development in Xicheng District and
331
Haidian District is relatively high, but its benefits are
greatly improved with its own input and output, it
needs to be adjusted to the input and output of the e-
government, so as to achieve the optimal allocation.
3.3.2 Research on the adjustment of input output
configuration of projection analysis
For non DEA effective decision-making unit, it can
adjust the value of the input and output index, so as
to make it an effective DEA. The formula for
adjustment and output is as follows:
X 'j 0 = θ *j 0 X j 0 − s *j − , Y j'0 = Y j 0 + s *j +
'
Among them, X is the input of the
j0
decision
j Y j'0
making unit after * 0 adjustment; for the
adjusted*+ output,*− θ j 0 for the relative efficiency
value; s j and s j are positive and negative slack
variables.
By adjusting the input and output data to analyze
the overall effectiveness of the 16 counties, we can
find the relative efficiency value of each decision
unit is 1, which can make the allocation of the
government input and output to the optimal, making
the development of E-government.
3.4 Conclusion and suggestion
3.4.1 Conclusion
3.4.1.1 The high risk of IT black hole caused by high
investment.
Through the above analysis, it can be seen,
although the overall level of e-government
development in Xicheng District and Haidian
District is relatively high, but the allocation of its
input - output has not reached the optimal. Among
them, the Xicheng District in the information service
industry, the number of employees to invest
redundancy;Haidian District in the local government
spending, the number of information service
industry, the proportion of information service
industry, such as investment redundancy; And the
two were in the public information, public
interaction, and part of the public service field, such
as health care, housing, marriage adoption of output
insufficient. This fully shows that the high
investment does not necessarily have a high output,
but also makes the development of electronic
government is facing the risk of IT black hole.
3.4.1.2 The redundancy of local financial investment
is a universal problem.
Through the above research, we can see that there
are more than 50% of the regional financial
investment in Beijing. This means that part of the
county government in the construction of
information technology budget, not fully take into
account the actual situation of the local and the
application of information capacity, the pursuit of
high investment in financial capital, the lack of
information on the construction of effective
performance budget.
3.4.1.3 Human resource agglomeration effect need to
be effective guide.
An accumulation of human resources will influence
its effect and excessive lack of play, has become the
constraints of e-government development.
According to the statistical data can be seen, Haidian
District and Xicheng District information service
industry practitioners accounted for than in the city
ranked respectively first and third. However, such a
high agglomeration effect has not been fully play,
but makes both in terms of the number of employees
in the information service industry input redundancy.
This shows that professional human resources need
to be effective in the government to formulate
policies to guide.
3.4.1.4 Building a service oriented government
needs to increase efforts in the public interaction.
Some of the higher level of e-government
development in the area of information disclosure,
public interaction and other aspects of the existence
of insufficient output, with a large room for
improvement. This shows that the public service on
the site is an important platform, the government
public information often cannot meet the needs of
the public, service content is not comprehensive, the
service is relatively simple, cannot give full play to
the social value of information resources. In
addition, in and public interaction, interactive
communication channels is single, old, is unable to
achieve the anticipation of the public participation in
government affairs, resulting in a government
website almost no one is interested in the
embarrassing situation.
3.4.2 Suggestion
3.4.2.1 The combination of clustering development
and differentiation development.
First, the county should pay more attention to the
introduction and development of information service
industry; Secondly, to promote the development of
information service industry in the area of
information service differentiation, and further
strengthen regional characteristics. The government
should encourage and guide the county according to
their own biggest advantages, choose to meet their
own characteristics of the information service
industry and industry sectors, to form the pattern of
regional dislocation development, but also to
promote the center city information service industry,
optimize the city's industrial layout.
3.4.2.2 Construction of scientific electronic
government budget system.
Different from the traditional budget system,
performance budgeting system and the traditional
budget system are different, which emphasizes the
performance as the premise, based on the annual
financial investment efficiency, the budget allocation
332
of funds for all levels, so that the financial
investment more scientific and standardized. Taking
into account the effect of information input, it has
some delay, so the cost and benefit analysis of the
past three to five years of cost benefit analysis,
combined with other departments at all levels of the
budget horizontal comparison, so as to achieve the
optimal allocation of electronic government.
3.4.2.3 Improving public information resource
sharing system based on public demand.
In addition to the government's own information
disclosure, transparency, the public's demand for
information is mainly concentrated in the medical,
education, employment, social security, housing,
transportation and other public information
resources sharing and development. Therefore,
government departments should closely follow the
latest trends in the domestic and foreign open
government data, research, deployment and promote
education, transport, health care and other public
services in the field of open data, encourage
enterprises ranking third party agencies to use public
data value-added development and utilization, and
the promotion of democracy, the credibility of the
government, people to understand and exercise their
rights, also can used for the society and enterprises,
so as to create more social value.
3.4.2.4 In order to enhance the value of citizen
participation in the development of E-government.
In the current "digital divide" cannot be eliminated
in the short term, the government departments
should actively develop e-government at the same
time, pay attention to the political participation of
vulnerable groups, will express the form and
channel; Establish the main position of citizen in the
performance evaluation of e-government, deepen the
consciousness of citizen participation; To improve
the implementation of the legal system of citizen
participation in e-government, to provide the system
guarantee for citizen participation; Making full use
of information technology and opening up new
channels and new channels of citizen participation in
E - government.
4 CONCLUSION
The conclusions of this study have important policy
implications: first, e-government as a large,
comprehensive social systems engineering, depends
on the government's strong investment and system
management, and in order to avoid falling into the IT
black hole, we need to establish a scientific and
effective e-government performance budget system.
Secondly, we should adjust measures to local
conditions, develop the information service industry
which is in line with the characteristics of the region
itself, and form the industrial pattern of differential
development and positive interaction. Third, the E-
government service object citizens, enterprises and
other interested stakeholders—government pressure
and demand in a large extent to promote government
to provide good e-government services, to encourage
the public participation, particularly the network
politics, will help to enhance the value of e-
government development.

REFERENCES

Dunleavy P, Margetts H, Bastow S. 2006. New Public

Management Is Dead—Long Live Digital-Era Governance.
Journal of Pubilc Administration Research and Theory, 16
(3):467-494.
Yanhua, Jin. 2013. The development prospect and
implementation strategy of mobile library. Library Work
and Study 2013(1):43-45
Fucheng, Zhang & Jun, Tang. 2004. E-government
Performance Evaluation: model comparison and real
analysis. Chinese Public Administration 2004( 5)
United Nations Department of Economic and Social
Affairs.2010.The United Nations e-government survey
2010: the use of E-government in the financial and
economic crisis 2010. 3.
Joan C.2004.teyaert.Measuring the Performance of Electronic
Government Services. Information & Management 2004
(41).
M.P. Gupta, J. Debashish. 2003. E-government Evaluation: a
Framework and Case Study. Government Information
Quarterly2003(20).
Lili, B. Stuart, G. Jon. 2005. Evaluating Web-Based E-
Government Services with a Citizen-Centric Approach.
Proceedings of the 38th Annual Hawaii International
Conference on System Sciences, 2005

333