See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/316087471

Analysis of usability of universities Web portals using the Prometheus tool -

SIRIUS

Conference Paper · April 2017

DOI: 10.1109/ICEDEG.2017.7962533

CITATIONS READS

3 138

5 authors, including:

Luis Chamba-Eras Roberto Jacome

Universidad Nacional de Loja (UNL) Universidad Internacional del Ecuador
41 PUBLICATIONS   72 CITATIONS    30 PUBLICATIONS   7 CITATIONS   

SEE PROFILE SEE PROFILE

Rene Guaman-Quinche Edison Coronel-Romero

Universidad Nacional de Loja (UNL) Universidad Nacional de Loja (UNL)
11 PUBLICATIONS   7 CITATIONS    14 PUBLICATIONS   5 CITATIONS   

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Middlware to integrate Google and Github Classrooms View project

Improving mathematics Learning View project

All content following this page was uploaded by Rene Guaman-Quinche on 23 July 2019.

The user has requested enhancement of the downloaded file.

 Analysis of usability of universities Web portals
using the Prometheus tool - SIRIUS
Luis Chamba-Eras, Luis Jacome-Galarza and Rene
Guaman-Quinche
Carrera de Ingeniería en Sistemas (CIS)
Universidad Nacional de Loja (UNL)
Loja, Ecuador
lachamba@unl.edu.ec, lrjacome @unl.edu.ec,
rguaman@unl.edu.ec
Abstract — The aim of this paper is to present a heuristic study
about the level of usability of 24 universities Web portals using
data mining techniques. For experimenting in this work, we used
a System for Evaluation of Usability of Web sites (SIRIUS) which
contains a tool to generate usability valuations of Web sites called
Prometheus and integrates 10 heuristics to do the process. The
assessments collected will give feedback to IT departments to
redesign, restructure or implement new Web portals that comply
with the standards of usability.
Keywords— Human-computer interaction; usability heuristics;
Web portals; Dataminig; Clustering; SIRIUS.
I. INTRODUCTION
The effective access to the information that the universities
of Ecuador give to their users, is the key for having visibility in
the digital environment, it also allows them to have presence in
the different academic rankings of universities around the world
that consider Web portals as one of its evaluation parameters [1].
The university Web portals are the face to the digital community
worldwide; they provide updated information and services
which give additional value to what these institutions offer in
their campus [2].
Users (students, teachers, administrative personnel,
authorities, citizens) access to the various services offered by the
universities Web portals to find a wide variety of information; it
can lead to the case in which users don’t find the information
they want or the access to the information is made in countless
steps. In Ecuador, there are not studies about usability of
universities Web portals, consequently, there are not
quantitative measures for making decisions, for this reason, it
arises the question that guides this research: What is the
quantitative value of usability of the universities Web portals
that belong to the National Research and Education Network of
Ecuador?
This paper is organized as follows: in section II it is
presented the state of the art of Web usability in universities. The
methodology used for the investigation is presented in section
III. In section IV it is shown the results and discussion. Finally,
in section V it is presented the conclusions and future works in
order to demonstrate that the Web usability must be considered
Edison Coronel-Romero and Milton Labanda-
Jaramillo
Unidad de Telecomunicaciones e Información (UTI)
Universidad Nacional de Loja (UNL)
Loja, Ecuador
edisoncor@unl.edu.ec, miltonlab@unl.edu.ec
when designing, implementing and evaluating Ecuadorian
Universities Web portals.
II. STATE OF THE ART
A. Preliminary Definitions
Usability is defined as an attribute that measures the ease of
use that Web interfaces have and it is a very important part in
the field of human-computer interaction (HCI) [3]. It is also an
empirical concept; this means that it can be measured and
evaluated. In fact, the usability is a quality attribute, whose
formal definition is the result of a list of different components or
variables through which it can be measured. These components
are mentioned: learnability, efficiency, quality of being
remembered (memorability), effectiveness and satisfaction [4].
Another definition in the context of the study is that usability is
the backbone that connects the university with the end user. Web
usability is an approach used to assess whether Web sites are
easy to use by end users without a prior effective training [5]. In
[3] four categories are described to work with Web usability:
inspection methods, heuristic, methods of inquiry and test.
Both in [6], [7] and [8] according to ISO 9241-11 define
usability as metrics or degree of a product that can be used by
specific users to achieve goals specified with effectiveness,
efficiency and satisfaction in a specified context of use.
According to [9], any system or product can be accepted as
usable if any user can find or achieve what s/he wants without
having problems or without requiring any help.
Several researchers have attempted to identify the elements
that contribute to good Web design and usability practices. This
has led to the appearance of a number of usability guidelines or
heuristics that has been developed for both generic user
interfaces and for designing Web sites. There are two types of
usability analysis tools: those which try to predict the use of Web
sites and those that work in accordance with standardized rules
[10].
Cognitive Walkthrough for the Web (CWW) is a
modification of the theory based on the method of testing
cognitive usability (CW) which uses the latent semantic
indexing [11] technique to estimate semantic similarity for
calculating information of each link. Through the use of CWW,
it analyzes likely behaviors of users who browse the Web with
specific targets that are wanted to be tested. It applies for every
page and it is useful to detect the following errors: links with no
recognizable meaning, pairs of semantically confusing links,
headings competing with each other for a specific purpose, links
competing with each other for a specific purpose; however, the
use of CWW is a cumbersome process because it is not able to
automatically analyze all pages of a Web site. The usability of
an application can be really difficult to determine. It is caused
by the complexity of the processes involved: user behavior and
system. The components that are regularly measured
(effectiveness, efficiency and satisfaction) are not strongly
correlated and are not consistently collected. Nowadays, the
improvements in terms of metrics are still very limited. There
are quantitative factors to do in usability testing (for example,
the time required to complete a particular task), but definitely a
lot of factors used to evaluate a system, (speaking of usability)
are qualitative. Either way, a test can dramatically improve a
product (either Web or not) when it detects the problems that
affect their full use, the application developers proceed to make
adjustments. Usability testing has been applied extensively in
the industry to evaluate the prototypes of diverse systems at
different levels of fidelity. The main objective is to get a list of
usability problems based on the observations of evaluators and
the analysis of users, considering both, their verbal and non-
verbal behavior. Tests often involve expert users performing a
walkthrough of the site, trying to emulate what a common user
would do. As the scan is performed, notes about detected
problems are made and alternative solutions are proposed [12].
The usability of Web sites play a central role in establishing
healthy communication between the university and its
stakeholders, undoubtedly this will contribute to the governance
of the university in many ways. The Web sites of universities
serve as a platform for the community to express their concerns
and demands of the university management, this will make to
listen to the concerns of stakeholders, and will provide to the
university administration the opportunity to make well-argued
decisions that contribute transparency which is the key
ingredient of good governance [13]. Usability has a correlation
with Web accessibility, while accessibility tries to overcome the
disabilities of the user when accessing to the information;
usability seeks to improve the user experience when using Web
sites. Accessibility would then be the ability of a Web site, or an
application, to provide users (regardless of their level of physical
or technological disability) access to it and its contents. And the
usability would be a way to measure how easy, quick and
pleasant it is to use this Web site or application. Both concepts
converge in the search for ease of access and consultation by
users to a Web site or an application [14]. The Heuristic
evaluation system SIRIUS [4], gives developers and evaluators
a set of criteria to consider in the process of development and
evaluation of a Web site, it also gives a quantitative
measurement in the range [0-10], which quantifies the level of
usability achieved on a Web site, considering the types of Web
site (16 considered) under evaluation, for doing adjustments in
its measurement, SIRIUS allows to know the evolution of Web
usability level over a period of time, preparing rankings of
usability, as well as the comparison between two or more Web
sites about the level of usability achieved. SIRIUS uses ten
aspects/rubrics (Table I) for each criterion that must be evaluated
by reviewers in the evaluation process.
TABLE I. ASPECTS OR RUBRICS OF THE SIRIUS SYSTEM
Acronyms Description
AG General Aspects
II Identity and Information
EN Structure and Navigation
RO Labeled
LA Page Layout
EF Understandability and ease of interaction
CR Control and Feedback
EM Multimedia Elements
BU Search
AY Help
Prometheus is a tool that implements the SIRIUS system; it
aims to detect usability problems in Web sites before or after
they are put in production, providing a reference, evaluation and
measurement tool. The results obtained through the tool enable
developers to make decisions to improve the usability of the site
in analysis, as it provides a score as a percentage that determines
the level of usability achieved by the site and the relationship of
the failed criteria sorted by their priority [4].
B. Related work
After the theoretical base presented in subsection II.A, the
research related to Web usability in universities environments is
described. In the work of Navarrete and Lujan [15], it is verified
by software tools the level of compliance of guidelines on Web
accessibility portals of the leading universities of Ecuador, they
recommend a manual analysis by experts in order to make a
complete and reliable analysis. In [16], work of Hassan et al., it
is addressed the usability, perceived by students, based on
theories from the fields of HCI, psychology, education, and
design.
Adepoju and Shehu [5], evaluate the usability of university
Web sites using automated tools and user testing methods.
Automated tools include HTML Toolbox and the Web Page
Analyzer. The research shows that factors like the download
time, image sizes, among others, are not in accordance with the
acceptable standard action. The level of user satisfaction was not
found encouraging. Moreover, Zaphiris and Ellis [17] evaluated
the content of Web usability and accessibility of the best
universities of United States of America; they used two
automated tools for it; Bobby and Ascensor. It was determined
that there was a low compliance (30%) with the WCAG 1.0
specifications and low-grade usability for most of the Web sites
of the universities. It was found that accessibility is significantly
correlated with overall scores of the usability of the Web sites.
Ozcorta Fernandez et al. [18] defines the evaluation of Web
usability as one of the simplest and most applicable tests that can
be done at any time of the design and maintenance of an
educational Web site. Bórquez et al. [6] uses SIRIUS for a Web
usability study of 25 Chilean Universities portals, supported by
a set of interrogation techniques. Jano et al. [19] conducted a
study of Web usability of universities in Malaysia and Australia,
they discover how the cultural factor has a great influence on the
appearance of the Web portals. Mendez [20] shows that it is
important and necessary to evaluate the design quality of a Web
portal through quantitative indicators that are distant from
subjective assessments.
Padilla and Carrion [7] show a practical approach to WEB
usability, seeking to be a quick guide for WEB developers to
become aware of the main items to make the interface of a
computer application user-friendly and accessible to all users
regardless of their capabilities or limitations of hardware and
software, or their physical capabilities.
Theo and Hong [8] discuss the methodology of usability and
the survey conducted for the webpage they built, researching
the different web usability elements needed to create a
successful website. They present the elements which are deemed
most important: Screen Appearance, Content, Consistency,
Navigation, Media Use, Interactivity and Accessibility
concluding finally that Content is the most important
determinant. In this work, when evaluating an improved
proposal of the website of the Center for Biometrics and
Biotechnologies (CBB) of Multimedia University of Malaysia,
through a questionnaire they obtain results that show that 77%
agree that the Improved CBB website is more effective and
efficient in terms of all usability criteria over the existing one,
while 23% respond that they fully agree that the site being
implemented is becoming more convenient and useful compared
to the existing one.
Ahmet [13] evaluate and explore the usability level of Namik
Kemal University (NKU). Six theoretical factors are posed to be
positively associated with website usability. The results of the
study show that 5 of the 6 factors can influence positively and
significantly with the perception of university users about
usability. Besides, this work provides guidance to develop better
and more usable web sites. In this work, the following results are
obtained from the analysis of the theoretical factors influencing
the usability of the Namik Kemal University site: the majority
of participants were male (63.8%) and approximately one third
of participants were female (36, 2%). More than 60% of the
participants were students, 28% were faculty members and the
rest (10.4%) were administrative staff. More than 50% of the
participants were less than 24 years old. Since most of the
participants were students, this finding is not surprising. Almost
half of the respondents (73.2%) were in the university for less
than 3 years. Since NKU is a relatively new university,
established only 5 years ago, and most of the participants were
students, this result is expected. More than 82% of participants
have been using the Internet for over 5 years. The most
commonly used Internet browsers have been Chrome (45.2%)
and Internet Explorer (34.1%). Finally, 37% of respondents
indicated that they spend more than 60 minutes online each time
they are connected and the percentage of respondents who spend
less than 5 minutes online is 27.6%.
Sengel [21] proposes to determine the usability level of
Sakarya University Web site on the Internet environment in
respect of “learnability, effectiveness, efficiency and
satisfaction”. For that it includes one-shot case design, and an
"observation method" is used to collect data about effectiveness,
efficiency and learnability. System Usability Scale with 10
questions is used to collect data about satisfaction. As a result,
all participants use the University Web site with higher success
and satisfaction. Then, in this work, the efficiency, effectiveness
and satisfaction of the usability of the Sakarya University web
site is measured, since the minimum time to complete the tasks
of the experiment was 653.4 seconds, the maximum time was
3294 seconds and the average time of 1600 seconds. Regarding
the effectiveness, it is measured by the success rate of the task
completion. The majority of the participants easily completed
the task, and only a few did not complete it because of the lack
of easiness. The Sakarya University satisfaction rate is
calculated using the Brook System Usability Scale, with a score
of 54.06 being placed below average satisfaction.
Hasan [22] present an university classification system called
Eduroute that could provide useful information on the usability
of university websites. A comparison between the results
obtained by Eduroute in relation to the ranking of the first three
universities in Jordan and the results obtained by the heuristic
evaluation method on the usability of the websites of the three
main universities, concludes that the ranking of the three
universities of Eduroute can be considered an indicator of
general usability of websites and identified fourteen common
usability problems in proven websites related to navigation,
design, content and ease of use and communication. In this work,
the usability of the three universities is evaluated, with Hashemit
University having the lowest usability index of 2.23 as
established in the research, while Yarmouk University has the
highest index High of 2.86; The University of Jordan has an
intermediate usability index of 2.59
Roy et al. [23] perform a statistical study to evaluate the
usability and accessibility levels of three popular academic sites
based on human (user) perception using two types of usability
evaluation techniques: questionnaire based and performance
based. Usability evaluation is performed by analyzing the results
of observed task success rates, task completion times, post-job
satisfaction scores and feedback. In this work, after the
performance-based usability analysis, the following results are
obtained in terms of the so-called Post-Scenario Questionnaire
(ASQ): KPG 6.2 with the highest participant satisfaction scores,
followed by the institute with D 5.1 and finally the K institute
with 4.4. With respect to the evaluation based on the WAMMI
standardized questionnaire, the KPG report gave a global
usability score of 48.48 for K 34.71 and for D 39.39.
Gullet et al. [24] evaluate the usefulness of an educational
website in Saudi Arabia, initially considering a series of
usability evaluation forms, but then selecting the heuristic
evaluation method for its ease and profitability; a questionnaire
is developed to accumulate the data and finally a charge based
on it is applied.
Kaur et al. [25] evaluate Educational Universities of Punjab
- India and provides their ranks according to evaluation criteria.
To find out the usability level, they make use of two automated
tools, Site Analyzer (which calculates different number of
parameters such as Content, Design, Performance, Search
Engines Optimization and Page Analysis) and the Qualidator
tool (which checks Usability, Accessibility, Search Engines
Optimization and Quality. In this work, they use the Qualidator
tool to evaluate the usability of the sites of 10 universities in the
Punjab region (between India and Pakistan), the following
results are obtained in percentage of usability: U1 67.1%, U2
58.0%, U3 76.0% U4 67.1%, U5 68.7%, U6 65.1%, U7 70.4%,
U8 73.8%, U9 79.4% and U10 67.1%, the results say that the
most usable website belongs to the University of Thapal
http://thapar.edu U9).
III. METHODOLOGY
The aim of the research is to present a heuristic study about
the level of usability of the 24 universities Web portals using
data mining techniques
Experimentation was conducted in a controlled laboratory
environment, based on the related work described in subsection
II.B. The study population was comprised of 24 Web portals of
universities that belong to the National Research and Education Fig. 1. Settings of the clusters in RapidMiner.
Network of Ecuador which has an undergraduate and graduate
academic offer.
In order to quantify the usability of Web portals, the
following steps shall be followed: (1) selection of university
portals, (2) technical evaluation of usability, (3) analysis of
results using data mining [26] and (4) presentation of
conclusions; these steps are defined in the methodology used in
[16]. During the evaluation process, the interrogation technique,
defined in [3], was used; it was considered the Prometheus tool
that supports the assessment of the usability of Web sites using
the evaluation system SIRIUS. For the step (1), the Web portal
CEDIA1 was used to access the Web portals of 24 universities,
this allowed to register each visited portal with a user role
(owner) in the Prometheus tool. In step (2) two actions were
taken, the first one was to conduct a comprehensive inspection
on each Web site, for this purpose, three pages of each site were
previously selected: (a) research; (b) teaching; and (c)
relationship with the society; later with a new role (evaluator) in
the Prometheus tool. During step (3) the preliminary quantitative
evaluation results were obtained using the l0 aspects/rubrics
Fig. 2. Visualization of three clusters after running in RapidMiner.
defined in the SIRIUS system. Finally, in step (4) a dataset that
summarizes the score of every aspect of the Web portals was
Cluster one (cluster1): there are 12 Web sites that belong to
obtained.
this cluster, this is the 50% of the population (see Fig. 2).
IV. RESULTS AND DISCUSSION Cluster two (cluster0): there are eight Web sites that belong
For each aspect/rubric was constructed a dataset2 for data to this cluster, this is the 33% of the population (see Fig. 2).
analysis, this dataset quantified in a single value for each Cluster three (cluster2): there are four Web sites that belong
aspect/rubric of usability. to this cluster, this is the 17% of the population (see Fig. 2).
We use the clustering technique of data mining [27] for the The clustering technique identifies that 50% of Web portals
analysis; we used the RapidMiner software [28] (see Fig. 1); in of universities meet usability standards proposed by SIRIUS.
this analysis we defined three clusters using the SimpleKMeans
algorithm [29] and Euclidean distance [30], these values are V. CONCLUSIONS AND FUTURE WORK
obtained by the Prometheus tool evaluating each page of Web
One of the contributions of the research is to obtain
portals: research, teaching and relationship with the society.
quantitative values of the level of usability of Web portals of
universities that belong to the CEDIA. Within the ranking of
universities that have a high percentage valuation of Web
usability, 12 of the 24 universities are present; this represents
approximately 50% of the population of the study.
The usability evaluation system SIRIUS presents a broad
spectrum of criteria from which 10 aspects/rubrics were
considered that were comprehensive and effective when
evaluating the Web portals, due to its simplicity; in a similar

1 Red CEDIA: https://www.cedia.org.ec 2 Dataset: https://github.com/lachamba/usabilidadwebec/tree/Datamining

way, the Prometheus tool allowed working in a semi-automated
manner during the evaluation process of Web usability.
The continuous feedback from users gave a valuable
contribution to the universities for improving their Web portals;
in order to meet the changing demands of users on the Web,
administrators can deploy a receive surveys in order to collect
data for a long time, which will allow the IT managers to make
decisions to improve the Web portals.
This work will allow IT administrators to implement policies
for the development of Web Portals with usability standards and
using free software.
As future work, it can be defined a study with new
comparison variables, such as end user’s questionnaires,
interviews with webmasters, among others; these instruments
will allow to define and adapt university Web portals to
international standards of usability.
Another possible field of experimentation is to create
intelligent tools that allow real-time monitoring in compliance
with standards of usability, being able to warn about the events
that occur in the environment and enabling IT managers to make
decisions independently.
ACKNOWLEDGMENT
Our thanks to the students of the Graphic Design subject at the
School of Computing and Multimedia of the “Universidad
Internacional del Ecuador extension Loja”, students of Systems
Engineering Department of the “Universidad Nacional de Loja”,
conducting pre-professional practices in Telecommunications
and Information department (UTI).
REFERENCES
[1] J. R. Hilera, L. Fernández, E. Suárez, and E. T. Vilar, “Evaluación de la
accesibilidad de páginas web de universidades españolas y extranjeras
incluidas en rankings universitarios internacionales,” Revista Española de
Documentación Científica, vol. 36, no. 1, pp. 1–16, Mar. 2013.
[2] L. Chamba-Eras, E. Coronel-Romero, and M. Labanda-Jaramillo,
“Usabilidad Web : situación actual de los portales Web de las
Universidades de Ecuador,” in Sexta Conferencia de Directores de
Tecnología de Información, TICAL2016 Gestión de las TICs para la
Investigación y la Colaboración, 2016, no. 6, pp. 557–569.
[3] L. Perurena Cancio and M. Moráguez Bergues, “Usabilidad de los sitios
Web, los métodos y las técnicas para la evaluación,” Revista Cubana de
Informacion en Ciencias de la Salud, vol. 24, no. 2, pp. 176–194, 2013.
[4] M. del C. Suárez Torrente, “SIRIUS: Sistema de Evaluación de la
Usabilidad Web Orientado al Usuario y basado en la Determinación de
Tareas Críticas,” Universidad de Oviedo, 2011.
[5] S. A. Adepoju and I. S. Shehu, “Usability Evaluation of Academic
Websites Using Automated Tools,” in User Science and Engineering (i-
USEr), 3rd International Conference on, 2014, pp. 186–191.
[6] V. Bórquez, R. Muñoz, E. Providel, T. Barcelos, and E. Ibáñez,
“Usabilidad de los Portales Web de las Universidades Pertenecientes al
Consejo de Rectores de Chile,” in XXIV Encuentro Chileno de
Computación ECC, 2012, pp. 1–13.
[7] R. Carrión and A. Padilla, “Usabilidad WEB: Pensando en el bienestar del
usuario,” Revista Tecnológica ESPOL – RTE, vol. 27, no. 2, pp. 67–78,
2014.
[8] K. K. Theo and T. S. Ong, “Explorations on Web Usability,” vol. 6, no.
3, pp. 424–429, 2009.
[9] J. Rubin and D. Chisnel, Handbook of Usability Testing, no. 1. 2014.
View publication stats
[10] A. Dingli and S. Cassar, “An Intelligent Framework for Website
Usability,” Advances in Human-Computer Interaction, vol. 2014, pp. 1–
13, 2014.
[11] R. M. Gutiérrez, “Análisis Semántico Latente : ¿Teoría psicológica del
significado?,” Revista Signos, vol. 38, no. 59, pp. 303–323, 2005.
[12] R. Baeza-Yates, C. R. Loaiza, and J. V. Martín, “Arquitectura de la
información y usabilidad en la web,” El profesional de la información,
vol. 13, no. 3, pp. 168–178, 2004.
[13] S. A. Menteş and A. H. Turan, “Assessing the Usabilty of University
Websites: An Empirical Study on Namık Kemal Universty,” TOJET: The
Turkish Online Journal of Educat,nal Technology, vol. 11, no. 3, pp. 61–
69, 2012.
[14] E. Mascaraque Serrano, “Accesibilidad vs usabilidad web: Evaluación y
correlación,” Investigacion Bibliotecologica, vol. 23, no. 48, pp. 61–103,
2009.
[15] R. Navarrete and S. Luján, “Accesibilidad web en las Universidades del
Ecuador. Análisis preliminar,” Revista Politécnica, vol. 33, no. 2, pp. 1–
8, 2014.
[16] Y. Hassan, F. J. Martín Fernández, and G. Iazza, “Diseño web centrado
en el usuario: usabilidad y arquitectura de la información,” Hipertext.net,
no. 2, pp. 1–14, 2004.
[17] P. Zaphiris and R. D. Ellis, “Website Usability and Content Accessibility
of the top USA Universities,” WebNet 2001 Conference, no. 2001, pp. 1–
6, 2001.
[18] E. J. Fernández Ozcorta, J. García Martínez, I. Tornero Quiñones, and Á.
Sierra Robles, “Evaluación de la Usabilidad de un Sitio Web Educativo y
de promoción de la Salud en Contexto Universitario,” Edutec-e. Revista
Electrónica de Tecnología Educativa, no. 37, pp. 1–27, 2011.
[19] Z. Jano, S. M. Noor, R. Ahmad, M. S. M. Saad, R. Saadan, M. Bokhari,
and A. N. Abdullah, “Website Usability and Cultural Dimensions in
Malaysian and Australian Universities,” Asian Social Science, vol. 11, no.
9, pp. 1–10, 2015.
[20] F. M. Méndez, “Análisis y medida de la ubicuidad y usabilidad de los
portales web de las universidades españolas,” Scire: representación y
organización del Conocimiento, vol. 14, no. 2, pp. 87–107, 2008.
[21] E. Sengel, “Usability level of a university web site,” Procedia -Social and
Behavioral Sciences, vol. 106, pp. 3246–3252, 2013.
[22] L. Hasan, “Using University Ranking Systems to Predict Usability of
University Websites,” Journal of Information Systems and Technology
Management, vol. 10, no. 2, pp. 235–250, 2013.
[23] S. Roy, P. K. Pattnaik, and R. Mall, “A quantitative approach to evaluate
usability of academic websites based on human perception,” Egyptian
Informatics Journal, vol. 15, no. 3, pp. 159–167, 2014.
[24] H. Gull, I. S. Zafar, and Saqib MAdeeha, “Usability Evaluation of an
Educational Website in Saudi Arabia,” VAWKUM Transactions on
Computer Sciences, vol. 1, no. 2, pp. 1–9, 2015.
[25] S. Kaur, K. Kaur, and P. Kaur, “Analysis of website usability evaluation
methods,” In Computing for Sustainable Global Development
(INDIACom) , 2016 3rd International Conference, pp. 1043–1046, 2016.
[26] H. A. Al-odan and A. A. A. K. Saud, “Open Source Data Mining Tools,”
in 1st International Conference on Electrical and Information
Technologies ICEIT’2015, 2015, pp. 369–374.
[27] R. Jingbiao and Y. Shaohong, “Research and improvement of clustering
algorithm in data mining,” 2010 2nd International Conference on Signal
Processing Systems, pp. V1-842-V1-845, 2010.
[28] A. Jović, K. Brkić, and N. Bogunović, “An overview of free software tools
for general data mining,” 37th International Convention MIPRO …, no.
May, pp. 26–30, 2014.
[29] P. Y. P. Yuqing, H. X. H. Xiangdan, and L. S. L. Shang, “The K-means
clustering algorithm based on density and ant colony,” International
Conference on Neural Networks and Signal Processing, 2003.
Proceedings of the 2003, vol. 1, pp. 0–3, 2003.
[30] N. Bouhmala, “How good is the euclidean distance metric for the
clustering problem,” Proceedings - 2016 5th IIAI International Congress
on Advanced Applied Informatics, IIAI-AAI 2016, pp. 312–315, 2016.
[31] jhjhjkhjkh
[32] bnmbmnbnmb