MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE (OSS) PROGRAMME

BENCHMARK/EVALUATION REPORT on WEB SERVERS for BUDGET 2008 DAY

AUGUST 2008

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Copyright
The government of Malaysia retains the copyright of this document.

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Table of Contents
1.0 EXECUTIVE SUMMARY.....................................................................................................1 2.0 INTRODUCTION..................................................................................................................1 2.1 Background ......................................................................................................................1 2.2 Purpose ............................................................................................................................2 2.3 Scope .............................................................................................................................3 2.3.1 Benchmarking activities ............................................................................................3 2.3.2 Visitor access statistic ..............................................................................................3 2.3.3 Personnel involved ...................................................................................................4 3.0 METHODOLOGY ................................................................................................................5 3.1 Benchmarking methodology ............................................................................................5 3.2 Visitor access recording and statistic generation ............................................................5 4.0 BENCHMARKING REPORT ...............................................................................................6 4.1 Benchmarking Activities..................................................................................................6 4.1.1 Experimental Setup ..................................................................................................6 4.1.2 Test System Specification And Configuration ...........................................................7 4.1.3 Commands Used ......................................................................................................7 4.2 Result of Benchmarking Exercise ..................................................................................9 4.2.1 Apache Web Server 2.2.3 .........................................................................................9 4.2.2 Lighttpd Web Server 1.4.15-1 ................................................................................10 4.3 Proposed Infrastructure Solution ...................................................................................11 5.0 BUDGET DAY SERVER OPERATION REPORT .............................................................13 5.1 Server Preparation Activities .......................................................................................13 5.2 Production Server Setup & Configuration ...................................................................13 5.2.1 Sysctl.conf ..............................................................................................................13 5.2.2 Synchronization scripts ..........................................................................................14 5.3 Budget Day Operation Report .....................................................................................17 5.4 Visitors Statistic For The Budget Day ..........................................................................17 5.4.1 General statistic ......................................................................................................17 5.4.2 Visitors per hour......................................................................................................18 5.4.3 Visitors by countries (Top 20) .................................................................................19 5.4.4 Visitors by operating system types..........................................................................20 5.4.5 Visitors by browser types.........................................................................................20 6.0 BENEFITS OF OSCC'S PARTICIPATION ........................................................................21 7.0 CONCLUSION ..................................................................................................................22 8.0 APPENDICES ..................................................................................................................24 8.1 Snapshot Treasury Portal during the Budget Day .........................................................24 8.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo embedded ...........25 8.3 Snapshot of Awstats reports...........................................................................................26 8.4 Snapshot of appreciation letter from MOF.....................................................................27

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

1.0

EXECUTIVE SUMMARY

This document is designed to provide detailed report of all exercises done by OSCC during their participation in preparing a dedicated web server for the Budget 2008 presentation day conducted by the Ministry Of Finance (MOF). Due to a massive visitor access spike projected during the budget day, OSCC team has been assigned to propose, set up and maintain a web server infrastructure solution based on Open Source technology that is reliable to handle the visitor surge, secure and cost saving. This solution is meant to replace the solution adopted by MOF for the past years that are too expensive and complex. The solution provided by OSCC has successfully performs reliably and receives more than 130,000 page views without any problem. The solution also saves MOF a huge amount of money as it eliminates the need of expensive hardwares and it only uses a single unit of server equipped with free Open Source softwares. All activities, findings and information will be presented in detail within this report which will be used as source of reference for similar implementation in the future.

2.0
2.1

INTRODUCTION
Background

Over the years Ministry Of Finance's (MOF) website (http://www.treasury.gov.my) receives a huge number of web accesses particularly during the national budget day presentation. These spikes of requests were caused by a large number of visitors trying to get information concerning the upcoming year's budget and also downloading the Malaysia Economic Reports in digital format documents. Visitors also access the website to get information about the live video broadcast of the presentation, and for this purpose the treasury website only provide a web URL to a third party portal that handles the web broadcast. For the past years OSCC had involved whether directly or indirectly in providing consultancy and human expertise in preparing a suitable server solution for the budget presentation day. It was

Page 1

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

reported that in 2005, during the Malaysian Budget 2006 presentation day, such huge visitor accesses had caused the web server to stall due to the excessive load congesting the server resources. This event had caused denial of service state to the server thus causing failure of web access requests to the visitors. To prevent the situation from happening again, for the Malaysian Budget 2007 presentation day in 2006, drastic approaches have been taken. An alternative server infrastructure consists of several unit of servers with load balancing approach was implemented to substitute the actual web server only for the budget days period. This solution was installed a few days prior to the budget date and being decommissioned several days after once visitor access numbers back to normal day to day routine. The solution had proven to be reliable as there are no denial of access reported but for MOF's view, it was somewhat too expensive and too complicated and they are seeking for a more practical and economical approach for the next national budget day. In August 2007, OSCC once again been invited to provide consultancy and to facilitate the preparation process for the Malaysian Budget 2008 presentation day. Both R&D and Technical Unit of OSCC involved cooperatively to propose, design, install and operates a suitable server solution for the budget day.

2.2

Purpose

The purpose of this document is to:1. Identify suitable web server infrastructure solution to be applied by Ministry Of Finance for the Budget 2008 presentation day 2. To identify whether or not a server load balancing formation is needed to handle high web access request on the particular day 3. To determine which type of web server package to be used 4. To provide reports of operations initiated during the actual budget presentation day 5. To present web access statistic captured for the whole budget day 6. To table any related findings gathered during and after the operation day
Page 2

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

The testing is not in any way done to declare which web server application is better compared to others, but merely to find which solution is the most suitable within the scope of our specific requirement. Therefore, any results, findings and recommendation provided in this report should not be considered as a generalized head to head comparison.

2.3 Scope 2.3.1 Benchmarking activities
Only two web servers software were selected to be the testing subjects which were Apache

(http://www.apache.org) and Lighttpd (http://www.lighttpd.net). All testing activities were done on machines with the same hardware specifications, identical operating systems and similar configurations and performance tuning settings. All testing were done in a lab located in OSCC. All network connections were Local Area Network in nature which means that maximum network bandwidth should be approximately 100Mbps.

2.3.2 Visitor access statistic
This report examines visitor activity log data for the website www.treasury.gov.my only for the budget presentation day which is on the 7th September 2007. Only genuine human visitor will be counted in the analysis and no visits or page hits by automated robots such as crawler, bots and external data mining agents will be used within this report. Due to the internet nature of 'the world without boundaries', visitor origins in the analysis will be from all over the world which is not limited to specific geographical location. Data that will be taken into consideration are hourly unique visitors and visitors which are divided by countries. The analysis will also provide comparison between operating system types and internet browser types to estimate the percentage in term of users who are using open source technologies.

Page 3

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

2.3.3 Personnel involved
Both RND and technical teams were involved directly with this project. There were also a number of personnel from MOF participate in various activities throughout the server benchmarking, server preparation and during operation day. OSCC personnel involved in the benchmarking activities: 1. Haris (R&D Unit) 2. Jamal (R&D Unit) 3. Hisham (Technical Unit) 4. Azizul (Technical Unit) 5. Maisarah (R&D Unit) 6. Indhran (R&D Unit) OSCC personnel involved for the server preparation and operation day: 1. Haris (R&D Unit) 2. Jamal (R&D Unit) 3. Hisham (Technical Unit) 4. Azizul (Technical Unit)

Page 4

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

3.0

METHODOLOGY
3.1 Benchmarking methodology

The benchmarking activities were done using an open source web server stress test tool called ApacheBench (AB). ApacheBench is a command line computer program for measuring the performance of HTTP web servers, in particular the Apache HTTP Server. It was designed to give an idea of the performance that a given Apache installation can provide. In particular, it shows how many requests per second the server is capable of serving. A series of testing were done on each test subject and the results were recorded. On each occasion, a number of connections and quantity of concurrency were pre-determined. If the test finished successfully, meaning all request been served effectively by the test subject without any failed or denied request, the number of concurrency will be increased and another round of test will be done. The procedures were repeated until the subject matters fail to serve. This would mean that the limit of connection that the particular web server can handle has been found. By using this method, a comparison can be made on which web server has the capability to serve the highest number of connections and maintain availability through sudden spike of visitor access.

3.2 Visitor access recording and statistic generation
Throughout the operation process including the budget presentation day, no additional monitoring tools were used on the web server rather than the conventional web server log capability provided by both Apache and Lighttpd. This is to minimize resource usage of the particular server to keep the free of unnecessary overhead. The web server logs are kept in the access_log. Analyses were done to the log after the budget day to generate meaningful statistic using an open source log analyzer tool called Awstat (http://awstats.sourceforge.net). AWStats is a free powerful and featureful tool that generates advanced web, streaming, ftp or mail server statistics, graphically. This log analyzer works as a CGI or from command line and shows you all possible information your log contains, in few graphical web pages. It uses a partial information file to be able to process large log files, often and quickly. It can analyze
Page 5

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

log files from all major server tools like Apache log files (NCSA combined/XLF/ELF log format or common/CLF log format), WebStar, IIS (W3C log format) and a lot of other web, proxy, wap, streaming servers, mail servers and some ftp servers.

4.0

BENCHMARKING REPORT
4.1 Benchmarking Activities 4.1.1 Experimental Setup

A series of benchmarking activities were done using the Apache Bench tool. 2 servers with identical hardware specification, Operating System and with Apache Machine A : IP address : 10.20.20.51 Apache 2.2.3 and Lighttpd respectively. Machine B : IP address : 10.20.20.52 Lighttpd 1.4.15-1 configurations were installed

Another machine was being set up as the testing terminal where the benchmarking and stress test tool will be executed. This machine was equipped with the Apache Bench Tool.

Page 6

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

4.1.2 Test System Specification And Configuration
All machines specification are identical. Using the same hardware model, operating system and configurations. Maker Model Processor RAM Hard Disk Operating System HP DC770 Intel(R) Pentium(R) D CPU 3.20GHz 512 MB 40 GB Linux CentOS 5

4.1.3 Commands Used
Command used to launch the benchmarking process ab –n 10000 –c xxx http://ipaddress/ Where :–n is the number of connections to be generated during the test emulating the number of web access estimated to be received by the server within a specific timeframe (approximately below 20 seconds) during the budget day. The value 10000 was pre-determined by the team as the appropriate number of estimated connection judging by the projected number of web access for the upcoming budget day based on the past years pattern. –c is the number of concurrent connection that will take place during the series of tests. This is the most crucial element within the benchmarking activities, understanding that the aspect of availability should be the highest priority in the choosing the most suitable solution. For each round of testing, the number of concurrent connection will be increased until error encountered which signals the actual limit where the web server capable of serving. Example : ab –n 10000 –c 500 http://10.20.20.52/ *Testing the Machine B with 10000 number of connection with 500 number of concurrency. During the test, system resource utilization was monitored and logged using vmstat
Page 7

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

command. This was to find any spike of resource usage or any occurrence of I/O bottleneck. Several data that were closely monitored were: CPU Idle To determine whether any excessive CPU usage occurred during the stress test process. High CPU Idle status means that Free Memory the system is healthy To determine whether any excessive RAM usage occurred during the stress test process. High Free Memory status means healthy that the system is

Page 8

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

4.2 Result of Benchmarking Exercise 4.2.1 Apache Web Server 2.2.3
Number of request (n) = 10,000

On each test round, Apache failed to surpass 400 concurrency connection level.

Page 9

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

4.2.2 Lighttpd Web Server 1.4.15-1
Number of request (n) = 10,000

Page 10

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Based on the above results, it is clear that Lighttpd capable of handling larger number of concurrent web requests compared to Apache when it comes to serving static web contents. The above rounds of tests were repeated a few times but the outcome persists. In addition, the team also tried a larger number of requests to the Lighttpd server which was supposedly beyond the scope of testing by increasing the –n number and the –c number and lighttpd proves to have the ability to withstand them.

4.3 Proposed Infrastructure Solution
Based on the results of the testing, the team has decided to opt for Lighttpd as the web server to use. We are confident that a single server with adequate hardware specification, equipped with Lighttpd could withhold the high number of web access requests during the budget day provided that the server only servers static contents without any server side scripting nor any king of database connectivity involved. To make sure that the server uses resources efficiently and to increase stability, several modifications and fine tuning configurations will be done to the production server. These include CPU & RAM allocation and kernel optimization tuning. Unneeded services were also turned off minimize resource overhead. All software installation, modification and tuning processes will be done by OSCC with assistance of MOF personnel. In addition, one unit of standby server will be also placed alongside the production server for
Page 11

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

contingency measure such as in the event of hardware failure to the primary server. The standby server also has the same configuration and contents as the production server with almost identical hardware specification. The team had also suggested the use of multiple servers located in different data centers if in case large binary files such as 'self extracting compilation of economic reports' were going to be served and made available to the public as what have been done in the previous years. Those servers will act as the alternatives download locations listed as download links within the download page in the main portal, where visitors can choose from. This method will reduce the burdens of the primary portal. Those server were also equipped with Lighttpd where minimal hardware specification as low as a Personal Computer (PC) specification could be used. Based on mutual agreement with MOF, three alternative download locations were identified. Those three servers are: • • • The standby server which are located in NetMyne Datacenter alongside primary server One unit of server located at Ministry of Finance One unit of server located at OSCC

A simple bash script was created to handle synchronization among servers to make sure that all servers have the same up-to-date web contents. The scripts will be provided in the later part of this document. *** However during the budget day, none of the alternative download servers were utilized, as there are no large binary files were served by MOF, and the main server showed no indication of congestion and it's resource utilization were successfully kept at the very minimum.

Page 12

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Overview of the proposed server structure for Budget 2008 presentation day

Page 13

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.0

BUDGET DAY SERVER OPERATION REPORT
5.1 Server Preparation Activities

All servers has been freshly installed with Linux CentOS 5 one week before the actual event. Several round of stress test were done on all machines to make sure they don't have any problem particularly on the hardware aspect. An overnight stress test also have be done using combination of AB stress tool and cron job to make sure that the servers are stable.

5.2 Production Server Setup & Configuration 5.2.1 Sysctl.conf
Exact file location: /etc/sysctl.conf #additional parameter to increase performance kernel.shmmax = 436883456 kernel.shmall = 268435456 kernel.sem = 500 51200 64 2048 kernel.shmmni = 4096 fs.file-max = 65536 net.core.rmem_default = 262144 net.core.wmem_default = 262144 net.core.rmem_max = 262144 net.core.wmem_max = 262144 net.ipv4.ip_local_port_range = 1024 65000 kernel.msgmni = 2048 kernel.msgmax = 65536 vm.page-cluster = 20 net.ipv4.tcp_rmem = 4096 87380 16777216 net.ipv4.tcp_wmem = 4096 87380 16777216 net.ipv4.tcp_tw_reuse = 1

Page 14

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.2.2 Synchronization scripts
The main script (called via command line at the primary server by the system administrator) Exact file location: /usr/local/bin/rsync-mof #!/bin/bash # mirror-script.sh # created by Jamal if [ $(whoami) = bajet08 ]; then echo -e "\n\nProcess started. Please wait..." /usr/local/bin/rsync-mdec2 sleep 1 /usr/local/bin/rsync-oscc sleep 1 /usr/local/bin/rsync-treasury echo -e "Process finished\n\n" else echo -e "Denied: Only bajet08 user can run this script\n" fi The above script will launch three series of rsync instances. /usr/local/bin/rsync-mdec2 #!/bin/sh # mirror-script.sh # created by Jamal DATE=`/bin/date +%y%m%d-%H%M%S` OUTFILE=/var/log/mirror/mdec2-$DATE.log date >> /var/log/mirror/mdec2-exec.log if [ -f "/home/bajet08/rsync-mof.pid" ]; then RUNPID=`cat /home/bajet08/rsync-mof.pid` if ps -p $RUNPID; then echo "Mirror is already running..." echo "Mirror is already running..." >> /var/log/mirror/mdec2exec.log exit 1 else echo "Mirror pid found but process dead, cleaning up" >> /var/log/mirror/mdec2-exec.log fi
Page 15

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

else echo "No process Detected" >> /var/log/mirror/mdec2-exec.log fi echo $$ > /home/bajet08/rsync-mof.pid echo -n "MDEC2 Server Mirroring Started at " echo "Mirror Started " >> /var/log/mirror/mdec2-exec.log date #$rsync $mirror $local > $OUTFILE 2>&1 /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \ /var/www/html/ 202.75.59.26:/var/www/html > $OUTFILE 2>&1 /usr/local/bin/rsync-oscc #!/bin/sh # mirror-script.sh # created by Jamal DATE=`/bin/date +%y%m%d-%H%M%S` OUTFILE=/var/log/mirror/oscc-$DATE.log date >> /var/log/mirror/oscc-exec.log if [ -f "/home/bajet08/rsync-mof.pid" ]; then RUNPID=`cat /home/bajet08/rsync-mof.pid` if ps -p $RUNPID; then echo "Mirror is already running..." echo "Mirror is already running..." >> /var/log/mirror/oscc-exec.log exit 1 else echo "Mirror pid found but process dead, cleaning up" >> /var/log/mirror/oscc-exec.log fi else echo "No process Detected" >> /var/log/mirror/oscc-exec.log fi echo $$ > /home/bajet08/rsync-mof.pid echo -n "OSCC Server Mirroring Started at " echo "Mirror Started " >> /var/log/mirror/oscc-exec.log date /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \ /var/www/html/ 210.187.27.213:/var/www/html > $OUTFILE 2>&1

Page 16

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

/usr/local/bin/rsync-treasury

#!/bin/sh # mirror-script.sh # created by Jamal DATE=`/bin/date +%y%m%d-%H%M%S` OUTFILE=/var/log/mirror/treasury-$DATE.log date >> /var/log/mirror/treasury-exec.log if [ -f "/home/bajet08/rsync-mof.pid" ]; then RUNPID=`cat /home/bajet08/rsync-mof.pid` if ps -p $RUNPID; then echo "Mirror is already running..." echo "Mirror is already running..." >> /var/log/mirror/treasuryexec.log exit 1 else echo "Mirror pid found but process dead, cleaning up" >> /var/log/mirror/treasury-exec.log fi else echo "No process Detected" >> /var/log/mirror/treasury-exec.log fi echo $$ > /home/bajet08/rsync-mof.pid echo -n "Treasury Server Mirroring Started at " echo "Mirror Started " >> /var/log/mirror/treasury-exec.log date /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \ /var/www/html/ 202.75.6.53:/var/www/html > $OUTFILE 2>&1

Page 17

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.3 Budget Day Operation Report
Several OSCC staffs have been located at all critical points where the servers reside. Each of them will monitor the log files activity of each server for any kind of problem. Live report file uploading processes were done by MOF's staff directly to the primary server and the synchronization scripts will distribute and duplicate the changes to other backup servers. There are no occurrence of error detected for the whole day and the backup servers were not utilized at all as the primary server shows any symptom of resources drainage.

5.4 Visitors Statistic For The Budget Day
Below is the visitor statistic collected during the Budget 2008 Presentation Day which was held on 7th September 2007. All data were taken from web access log and was analyzed using Awstats. Only the primary server was used during that day, therefore all statistics shown here are purely from a single server.

5.4.1 General statistic
Date : 7th September 2007 Total number of unique visitors Total number of visits Total number of pages viewed Total number of hits generated Total bandwidth consumed 9, 874 12, 796 (1.29 visits/visitor) 130, 398 (10.19 Pages/Visit) 519, 184 (40.57 Hits/Visit) 4.58 GB (374.95 KB/Visit)

Page 18

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.4.2 Visitors per hour
Hours 00:00 am 01:00 am 02:00 am 03:00 am 04:00 am 05:00 am 06:00 am 07:00 am 08:00 am 09:00 am 10:00 am 11:00 am 12:00 pm 01:00 pm 02:00 pm 03:00 pm 04:00 pm 05:00 pm 06:00 pm 07:00 pm 08:00 pm 09:00 pm 10:00 pm Pages 282 145 114 96 56 45 110 671 1,979 2,505 2,739 3,046 2,192 1,626 5,388 16,097 32,647 28,605 12,070 5,166 3,335 5,187 4,551 Hits 1263 601 486 377 160 144 504 3,800 10,428 11,851 12,972 14,192 10,347 7,457 23,544 76,505 150,655 104,234 33,375 16,029 11,222 12,175 10,335 Bandwidth 7,619,401 4,713,187 3,400,969 2,695,992 973,597 1,096,283 3,377,156 18,702,079 56,068,174 70,603,683 79,936,375 79,977,401 59,969,313 44,138,365 142,280,704 393,637,888 580,046,848 1,040,812,032 835,983,360 343,683,072 264,849,408 405,623,808 380,430,336

11:00 pm 1,746 6,529 92,384,038 * The above data doesn't includes traffic generated by robots, worms, or replies with special HTTP status codes.

Page 19

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.4.3 Visitors by countries (Top 20)
No 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14. 15. 16. 17. 18. 19. 20. Malaysia United States Singapore Japan Australia India Hong Kong European country Great Britain France Indonesia China Germany South Korea Philippine Taiwan New Zealand Qatar Switzerland United Arab Emirates Country Pages 119,908 2,559 2,468 1,125 715 551 541 439 379 191 179 161 154 134 74 67 61 48 45 42 Hits 485,441 7,589 6,838 3,672 2,862 953 2,103 1,640 1,422 755 636 672 466 646 198 290 278 141 224 177 Bandwidth 4.29 MB 59.42 MB 61.50 MB 20.01 MB 22.97 MB 45.21 MB 12.63 MB 14.87 MB 17.34 MB 3.86 MB 4.95 MB 3.30 MB 3.92 MB 2.31 MB 1.62 MB 1.97 MB 1.24 MB 1.56 MB 1.22 MB 0.53 MB

Page 20

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.4.4 Visitors by operating system types
Operating Systems 1. 2. 3. 4. 5. 6. Windows Unknown Macintosh Linux Symbian OS Sun Solaris Hits 500,848 14,574 1,829 1,559 332 42 Percent 96.40% 2.80% 0.30% 0.30% 0% 0%

5.4.5 Visitors by browser types
Browsers 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. MS Internet Explorer Firefox NetAnts Mozilla Unknown Opera Safari Netscape RssReader (RSS Reader) K-Meleon Others Hits 445,607 54,316 10,638 2,244 1,919 1,826 1,764 570 82 37 181 Percent 85.80% 10.40% 2.00% 0.40% 0.30% 0.30% 0.30% 0.10% 0% 0% 0%

Page 21

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

6.0

BENEFITS OF OSCC'S PARTICIPATION
Benefits for OSCC

1. OSCC gained significant visibility during Budget Day 2008 by having its logo embedded within the treasury.gov.my website from 2.00pm until 5.00pm. More than 250,000 hits generated during that time-frame. 2. Valuable knowledge based on research about comparison between 2 open-source web server (Apache/Lighttpd). 3. Data will be used for OSCC OSS benchmarking reports as part of RND department deliverables 4. Transfer of technology, exposure and knowledge sharing about Open Source technology to MOF. 5. Providing solid proof about reliability, flexibility and future potential of open source products . 6. Valuable lessons and experience for all OSCC Technical and RND department staffs . 7. Helping MOF in substantially reducing the total cost for preparing budget day server compared to previous years.

Page 22

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

7.0

CONCLUSION

Overall, our recommended server infrastructure solution performs reliably in serving such high number of web access for the www.treasury.gov.my portal during the budget 2008 presentation day. All requests were successfully served and the server did not encounter any kind of problem such as network congestion or service interruption during the production period. The resource utilization of the server also kept at very minimum with majority of the system resources such as CPU and RAM were underutilized which means that the same setup could theoretically handles even larger number of web access request in the future if the same infrastructure solution and practices were to be reused.

Both MOF and OSCC have gained valuable experiences and knowledge throughout each of the project phase especially during the benchmarking, installation and production phase. Those knowledge and experience would be helpful in improving OSCC operation most importantly in the technical aspects in the future. The benchmarking activities have provided valuable knowledge especially in realizing the solidness of open source web server products particularly for Lighttpd web application. Although the team did not took the results as absolute declaration of which web server is the better compared to others as there a a lot of external variables should be considered in making any justification, nevertheless it was a good indicator of the wide variety of possibilities offered by the open source world where there are so many alternatives to choose from in catering any specific needs.

Based on number of visitors divided by operating system types and internet browser types, Microsoft has proven that they dominated the operating system and internet browser application market especially for desktop workstation among the internet users particularly in Malaysia. This information is crucial to the future strategic planning for OSCC as it could be used as a guideline or reference in tabulating the trend of open source usage among the Malaysian people. Only 0.30% of the total visitors were using Linux operating system while for

Page 23

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Open Source internet browser, Firefox only manage to achieve slightly above 10%.

The number is tremendously small compared to the Microsoft and shows that user acceptance toward open source technologies for desktop workstation and software application is still arguable and majority of computer users are still prefer proprietary products. This is also indicates that there are still a large room for OSCC to work on in the future.

Prepared by: Harifazillah Jamel, OSCC MAMPU
Page 24

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.0 APPENDICES
8.1 Snapshot Treasury Portal during the Budget Day

Page 25

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo embedded

Page 26

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.3 Snapshot of Awstats reports

Page 27

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.4 Snapshot of appreciation letter from MOF

Page 28

Sign up to vote on this title
UsefulNot useful