You are on page 1of 6

Accessibility and microcopy remote testing of mobile

applications:
The case of the CeNTER platform

Oksana Tymoshchuk, Eliza Oliveira, André Branco, Daniel Carvalho, Maria João Antunes, Luís Pedro, Ana
Margarida Almeida, Fernando Ramos
Department of Communication and Art / DigiMedia
University of Aveiro
Aveiro, Portugal
{oksana, elizaoliveira, acastello, daniel.carvalh, mariajoao, lpedro, marga, fernando.ramos}@ua.pt

Abstract — When designing a digital solution aimed at CeNTER, is under development to encourage interactions
community initiatives, it is necessary to have a great concern with between local agents (citizens, communities, entities, and
all potential users, ensuring it can be easily used by anyone, networks), facilitate communication and collaboration
regardless of any sensory or motor limitations. This article processes, benefit from existing mediation strategies and
reports the developmental stage of a mobile application, which encourage the joint creation of new ideas/activities [3,7].
aims to promote collaboration and cooperation between different
agents involved in the territorial innovation process. Accessibility The prototype was developed using a user centered design
and microcopy evaluations of the application prototype were approach, through an iterative process of continuous
carried out to improve its accessibility and ensure its use by users improvement [7]. The CeNTER mobile application prototype
in several circumstances, contexts, and conditions. Due to the was developed with the support of the "Principle" software.
Covid-19 pandemic current restrictions, the tests were performed The main screen of the application has six tabs: initiatives,
remotely, allowing the development team to deepen knowledge activities, entities, volunteers, resources, and highlights (Figure
about the different methods and tools for implementing remote 1). When opening each of the tabs, the user finds the
tests. This paper presents the results of this methodology of information presented in a carousel mode, with cards
evaluation, which contributed to assess the CeNTER mobile presenting different contents. The cards have essential
application's adequacy and make improvements aimed at information (e.g., image, date and time, location) and can be
ensuring its accessibility and universality.
manipulated with gestures such as swiping (e.g., discard or
Keywords - mobile application; accessibility; microcopy test;
save as favorites). Browsing content is done with a minimum
remote test; digital technologies; community-led initiatives; amount of movement.
territory-based innovation.

I. INTRODUCTION (HEADING 1)
Digital technologies can have a significant impact on
innovation and territorial development, as they offer tools for
regional actors to share information and build collaborative
knowledge, essential for the development of community
initiatives [1,2].
However, research under the CeNTER Program found that
community initiatives in the Central Region of Portugal still
face several challenges in the use of digital technologies within
the scope of their activities. These challenges are mainly
related to: i) excess of unclassified information; ii) the
multitude of digital tools that forces the community to manage
too many things (digital messaging services; productivity tools; Figure 1. Homescreen of the version of the medium-fidelity prototype.
tools for obtaining feedback, etc.); iii) the complexity of these
tools; iv) the lack of digital telecommunications equipment and The prototype was tested using a heuristic evaluation, with
infrastructure, mainly in rural areas; v) the low level of digital the participation of five specialists in the field of digital
skills, especially among senior participants [3,4]. technologies and five specialists in the field of Tourism,
Health, and Wellness [8]. For the CeNTER app prototype
Community-led initiative representatives also reported the evaluation, Nielsen's heuristics, MATCH-MED scale, and
lack of a digital platform that is able to mediate and facilitate Think Aloud Protocol allowed it to improve usability and
interaction, collaboration, and cooperation between community gather qualitative data from the users [9]. The CeNTER
initiatives, institutions, volunteers, and local populations [5,6].
To meet these needs, a mobile application prototype, called

2021 16th Iberian Conference on Information Systems and Technologies (CISTI)


23 – 26 June 2021, Chaves, Portugal
ISBN: 978-989-54659-1-0

Authorized licensed use limited to: b-on: UNIVERSIDADE DE AVEIRO. Downloaded on July 14,2021 at 09:44:37 UTC from IEEE Xplore. Restrictions apply.
prototype was well evaluated among the specialists of the two with the guidelines, such as those of WCAG 2.0; ii) automated
groups. tests of compliance with guidelines, through the use of
automated tools for evaluating accessibility that present
Additionally, prototype accessibility and microcopy content deterministic results; iii) manual inspection by experts, a
tests were made in order to ensure the development of an method that uses human action and serves predominantly to
accessible mobile application. This article reports the obtain results that cannot be obtained automatically, and can be
methodological procedures and the main results of these two composed of teams with knowledge of accessibility guidelines.
tests of the CeNTER application prototype. It is important to
mention that due to the epidemiological situation related to B. Microcopy Test
Covid-19, a remote methodology was adopted to conduct these Microcopy is a recent area of knowledge that is strictly
two tests. related to the words or phrases in the user interface that are
II. CONCEPTUAL BACKGROUND associated to actions (for example, a click), which comprise the
motivation before the action, the instruction that goes along
A. Accessibility and Mobile Applications with the action, and the feedback after the user has
Accessibility, a subclass of usability, allows everyone to accomplished the action [15]. It is a central element of User
access the same content, regardless of any functional or Experience since it determines the relationship between the
situational limitations [10]. Web Content Accessibility interface and its users into a reciprocal connection that enriches
Guidelines (WCAG 2.0) have been defined to facilitate the and even changes the mood [16]. In Yifrah’s [15] words: “Just
development of accessible web applications. It presents 3 adding a few words in the right place at the right time could
levels of compliance, with 'A' being the minimum accessibility completely change the user experience” (p. 7).
rating and 'AAA' being the standard of excellence [10]. An accurate microcopy can: i) engage the user, since it
WCAG 2.0 also provides four generic principles for changes the relationship from a robotic functional encounter to
accessible development: i) perceivability, meaning that a human and personal experience; ii) increase usability,
information and user interface components must be presentable preventing problems in completing an action and saving
to users in ways they can perceive them; ii) operability, valuable time; and iii) enhance branding and differentiation by
meaning that user interface components and navigation must sharpening the key messages to the target audience and
be operable; iii) understandability, meaning that information creating an authentic and unified experience throughout the
and the operation of the user interface must be understandable; interaction with the audience [15].
iv) robustness, meaning that the content must be robust enough In this context, Roberts [17] and Leon [16] provide a
to be interpreted reliably by a wide variety of user agents, complete guide to produce an accurate microcopy. For
including assistive technologies [11]. example, microcopy must be written in a natural human
However, the development of an accessible mobile language that is simple and easy to understand. Therefore,
application is a challenge due to several particularities of jargon and technical system details should not be used. Also,
mobile phones. According to Billi et al. [10], mobile devices microcopy should explicitly define what actions are being
have several limitations inherently related to the small screen, performed, including coherence between button labels and
such as restricted input resources and connectivity, narrow and what action will happen when clicked, providing specific
expensive bandwidth, reduced computing resources, limited information about interaction and what action(s) can be taken
energy and wide heterogeneity. next.

It is, therefore, important to highlight that accessibility Regarding the assessment, usability tests can determine if
guidelines must be considered in the development process of the microcopy is appropriate in the context of the user's
mobile applications [10]. Although WCAG 2.0 presents a actions, and if it matches the audience. A/B testing is also an
collection of guidelines suitable for web developers, there was, alternative to evaluate which variations of microcopy have the
to this date, no standardized orientations for mobile devices greatest effect. In this case, it is possible to analyse the
[11]. Several authors have also tried to adopt different methods effectiveness of a microcopy by measuring the performance of
to evaluate accessibility in mobile devices, based on a task- the screens and controls [16]. In addition, Yifrah [15] states
centric approach [10,11,13]. that microcopy content evaluation encompasses several
methods, such as surveys and questionnaires;
Companies like Apple and Google also contributed by feedback/comments made about the brand; inquiries received
establishing quality guidelines in the development of from the contact form; recordings of usability testing;
applications for iOS and Android, respectively. Some of the transcripts from focus groups; and interviews.
contributions were resources and documentation, as well as
assistive technologies such as screen readers (TalkBack and C. Remote Evaluation Method
VoiceOver), controlling the phone from voice commands Remote testing is a recommended strategy in the
(Voice Access) or customizing some display features, such as accessibility assessment processes. Preece et al. [18] state that
bold text, contrast, transparency or motions (Apple it allows individuals with disabilities to be involved, as they
functionality). are, often, limited to remote scenarios (as work from their own
homes). Remote testing can be moderated or unmoderated.
Freire et al.[14] also highlighted three methods that can be
used to evaluate accessibility: i) conformity assessments, i.e., Moran and Pernice [19] mention that remote moderated
to check if the characteristics of a website are in accordance testing can deliver high-quality findings (comparable to in-

2021 16th Iberian Conference on Information Systems and Technologies (CISTI)


23 – 26 June 2021, Chaves, Portugal
ISBN: 978-989-54659-1-0

Authorized licensed use limited to: b-on: UNIVERSIDADE DE AVEIRO. Downloaded on July 14,2021 at 09:44:37 UTC from IEEE Xplore. Restrictions apply.
person testing) but is convenient and inexpensive (like remote process; ii) The first contact with the expert - an email was sent
unmoderated). Its main benefits are: i) the facilitator may inviting the expert to participate in the test. After accepting the
reorder tasks as needed; ii) follow-up questions for clarification invitation, the files with the prototype and a consent
can be asked; iii) and participants are less likely to spend time requirement were sent to the evaluator. iii) Pre-test session
on activities unrelated to the test [19]. (remote) - setup all technology necessary for the testing (install
Principle and ApowerMirror application); iv) Accessibility test
Unmoderated tests do not require a researcher to attend (remote) - the test was moderated, with the presence of one
each test session; instead, a software application provides accessibility expert and researchers from the CeNTER team.
instructions to users, records their actions, and may ask them
predetermined follow-up questions. The authors mention there The test occurred on May 5th, 2020 and lasted 3 hours and
are some advantages in these tests like: i) no moderation skills 30 minutes. The session started with the accessibility expert
needed; ii) easy test setup; iii) fast results; iv) and low cost. being invited to explore the open screen and the following
However, unmoderated remote testing has some drawbacks, menu. The expert was asked to comment on what she was
such as: i) variability in motivation of participants and looking for or reading, what she liked and disliked about the
commitment to the test; ii) high chance that testers will application and what made it easy or difficult to execute. The
multitask or get distracted by their environment; iii) and short expert shares her phone screen on her computer, using
test sessions [19]. ApowerMirror software. Thereafter, the expert used Zoom to
share her computer screen with the CeNTER team members,
Schade [20] recommends seven steps for remote testing: i) allowing to follow every step of navigation and user experience
choose a good tool for communicating with participants. ii) on the prototype. The results were transcribed and analysed
plan how to administer tasks; iii) schedule a meeting with using a grid, defining the levels of priority and complexity of
participants and a practice session before testing; iv) send problems detected. All the demands were prioritized for further
reminders to participants and observers for pre-test and to development. After the test analysis, the issues were reviewed,
testing session; v) try to enter the session a few minutes before fixing the identified problems and implementing the
the participants; vi) start the session with the user connected, improvements.
trying to make participants feel comfortable; vii) end the
session thanking the participant, stop and save the record. B. Accessibility Tool Evaluation
Furthermore, a pre-test to help to refine this process is advised, The Contrast Checker Tool was used to check the contrast
testing the equipment and hardware, as well as checking the and audit screen elements according to WCAG 2.0 [10]. Due to
record capabilities of the hardware on this pre-testing session. prototype limitations, compared to a final version of the
III. METHODOLOGY application, this evaluation focused on the 1.4 WCAG 2.0
guideline “Distinguishable: Make it easier for users to see and
This study was carried out under the CeNTER Program, hear content including separating foreground from
developed at University of Aveiro. One of the objectives of this background”. Some of the limitations stem from the Principle
program is the prototyping and validation of a mediation software itself, making it impossible to analyse several
platform for territorial innovation, with a focus on the areas of guidelines that required a screen reader. Therefore, it was
Tourism, Health, and Well-Being. The prototype of a mobile chosen as the Contrast Checker Tool software able to analyse
application, named CeNTER, was created for this purpose. guidelines by reading the background and foreground from
The CeNTER mobile application is a prototype of medium- print screens of the prototype.
fidelity and was developed with the Principle software for This test emphasised an analysis of application screens and
iPhone. A total of 74 screens were developed, as well as the content, including foreground and background contrast Colour,
main interactions between them. It was evaluated under contrast and text sizes standards were analysed. To increase the
accessibility and microcopy tests, in order to improve the accuracy on evaluation about foreground and background texts,
accessibility and understanding by people with different parts of the application screen colour and contrast have been
conditions and in different contexts. analysed separately. After evaluating the main application
Due to the pandemic situation, the remote test methodology screens, the analysis proceeded to use the Contrast Checker
proposed by Schade [20] was adopted. Tool, in order to verify the instances of violations of WCAG
2.0, considering the success criteria defined. The results were
A. Expert Accessibility Evaluation provided exclusively by the tool, with no human intervention.
The accessibility test was carried out through expert The issues were summarized and analysed with the support of
evaluation and the use of accessibility testing tools. The test a spreadsheet. All the violations of WCAG 2.0 were fixed on
with the accessibility expert was organized in four steps: i) the application, adjusting foreground and background colours.
Selection of free tools to record the screen of the expert's C. Microcopy Evaluation
mobile phone (e.g., TeamViewer, iPhone screen recorder). The
ApowerMirror tool was selected according to its compatibility The Microcopy Content was built based on the guide
with iPhone and Principle software, allowing researchers to presented in the book Microcopy: The Complete Guide [15].
capture the user experience on all screens. ApowerMirror Further, the microcopy test intended to identify whether the
allows the research team to share the mobile phone screen on a textual content, used in the CeNTER application prototype, is
notebook. The Zoom platform was selected for the video adequate and correct, considering the context of the project. An
meeting, to share the expert´s screen and record the evaluation unmoderated expert evaluation was conducted, aiming to
support the lexical and terminological validation of the

2021 16th Iberian Conference on Information Systems and Technologies (CISTI)


23 – 26 June 2021, Chaves, Portugal
ISBN: 978-989-54659-1-0

Authorized licensed use limited to: b-on: UNIVERSIDADE DE AVEIRO. Downloaded on July 14,2021 at 09:44:37 UTC from IEEE Xplore. Restrictions apply.
contents used in the application. All the 215 textual elements, the application. These were not implemented in the prototype
presented in the interfaces, were evaluated in terms of the for the reason of technical limitations from the Principle
adequacy of each textual content, using a Likert scale, and software, since it does not allow to implement complex
whether the content was correctly used or not. Further, the interaction gestures.
expert was invited to provide suggestions for changing the
textual elements that, in his opinion, should be modified. The In the first screen analysis with the Contrast Checker Tool,
data were subsequently analysed by the CeNTER team. The the application screens failed in five out of six guidelines
expert was a Portuguese and Linguistic Professor at the issues. Screen contrast, involving foreground and background
University of London and University of Aveiro and the test colours and thickness were identified. As noted by Serra et al.,
occurred between June 19th and July 10th, 2020. A grid with [21], many color combinations with low contrast can make a
all the lexical contents presented in the CeNTER prototype mobile application difficult to use for users with low vision.
interfaces was developed for the evaluation task. This This is particularly concerning as many people can use such
microcopy content grid was sent by e-mail to the expert, along applications in mobile devices in different places, with
with a pdf document with the images of the prototype's different lighting and seeing conditions. After several analyses,
interfaces. Despite being unmoderated, all questions presented a redesign was done in the application screens. A second
analysis was made and five out of six guidelines’ issues were
by the reviewer were answered by e-mail and the team was
always available to clarify any issue that could eventually approved for people with disabilities.
emerge. B. Microcopy Evaluation
IV. RESULTS AND DISCUSSION With the microcopy test it was possible to achieve results
that enabled the improvement of the textual elements used in
A. Accessibility Evaluation the prototype. The main results of the microcopy test
During the remote accessibility evaluation testing, 74 encompass the classification of the expert’s suggestions in
screens of the prototype were analysed on a moderate test with different categories, as well as the quantitative analysis of data.
an expert. The test was conducted with spreadsheet support. Twenty-three textual adjustments were suggested by the
Each issue on the spreadsheet was divided into points of expert, to the 215 textual elements used in the prototype. The
attention and opportunities for improvement, with an extensive adjustments were classified according to the categories
description to support a further classification. The issues were indicated on Table 2. Some suggestions were related to more
classified by priority and development effort. The spreadsheet than one category, originating a total of 29 items.
had a total of 42 issues separated on 13 (31%) high priority, 11
(26%) medium and 11 (26%) low priority. Seven issues were TABLE II. CATEGORIZATION OF THE SUGGESTIONS MADE BY THE
EXPERT TO THE MICROCOPY OF THE PROTOTYPE
not implemented since they could only be developed after the
prototyping phase of the project. This prioritization and effort Domains Number of Percentage
classification enabled the preparation of a task order for all the suggestions %
Difficult / ambiguous text 4 13,8
42 issues (Table 1).
Inconsistency in the language 2 6,9
(Portuguese from Portugal and
TABLE I. ACCESSIBILITY REPORT
Portuguese from Brazil)
Priority Issues reported Percentage % Comment related to specific 3 10,3
terminology
High 13 31
Alternative vocabulary suggestion 11 37,9
Medium 11 26
Grammatical error 6 20,7
Low 11 26
Orthographic error 3 10,4
Not implemented 7 17
Total 42 100 Total 29 100

More than 80% of the issues pointed out by the expert were Most of the suggestions were related to modifications in
related to understandable, perceivable, and distinguishable vocabulary, including changing, removing or adding textual
difficulties regarding screen elements. The expert pointed out content to replace the original. In addition, there was a
that some elements were not consistent between application significant number of errors related to grammatical and
screens, or the elements had a low contrast on the foreground ambiguity/difficulty texts, indicating that the main problems
and background colours. Another type of issue that emerged identified were related to the systematization of lexical
was related to navigation problems that could be difficult for elements and structuring of texts. Regarding the quantitative
people with visual disabilities. Special moves with fingers, analysis related to whether the content is correct or not, 201 out
such as drag and drop cards on the application, were pointed as of 215 (93,5%) was classified as being correctly used, while 14
a difficult task for someone with disabilities. out of 215 (6,5%) was incorrectly used.
According to Freire [14], it should also be considered that Concerning the assessment of the adequacy of each textual
these problems may not be completely solved even if the content, based on a 5-point Likert scale (0 - inadequate; 1 –
WCAG 2.0 guidelines are scrupulously followed. In this low adequacy; 2 - neither inadequate nor adequate; 3 –
context, it is noticeable that the referred author complemented adequate; 4 - very adequate), the expert scored each option in
his study through interviews with the end-users, which the following frequency (Table 3).
underlines the importance of obtaining direct feedback about

2021 16th Iberian Conference on Information Systems and Technologies (CISTI)


23 – 26 June 2021, Chaves, Portugal
ISBN: 978-989-54659-1-0

Authorized licensed use limited to: b-on: UNIVERSIDADE DE AVEIRO. Downloaded on July 14,2021 at 09:44:37 UTC from IEEE Xplore. Restrictions apply.
well as to ask questions and get instant evaluators’ feedback. In
opposite, due to a large quantity of microcopy elements to
TABLE III. TABLE TYPE STYLES evaluate, the unmoderated approach allowed more time to
Scalea 0 1 2 3 4 analyse the content. This technique ensured, therefore, an
Numbers of items 0 3 3 2 207 accurate feedback, as well as a quick answer to the questions
Score (total of 843) 0 3 6 6 828 and clarification of the expert’s doubts by telephone or e-mail.
Percentage 0 1,4% 1,4% 0,9% 96,3%
Some limitations of this work included the fact that
a. 0-inadequate; 1–low adequacy; 2-neither inadequate nor adequate; 3–adequate; 4-very adequate.
Principle software does not allow the appliance of some
assistive technologies, such as screen readers, having been
Considering the results above, the total score achieved is necessary to resort on the assistance of an accessibility expert.
843 (98%), which corresponds to the sum of the scores Another restriction found, with the use of this software, was the
obtained, with a maximum score possible being 860 (100%), impossibility to apply automated tests of compliance to check
proving that the overall results are very positive. the accessibility ratio on used fonts and colour contrast,
although these issues were revised with software that required
It is worth to stress that special attention was requested to manual input. Further, as future work the CeNTER team aims
the terms related to the CeNTER main concepts (initiatives, to amplify the project to a multiplatform approach, that could
events, resources, entities, volunteers, highlights, ideas). work on a wide range of devices and potentially improve
Specifically, regarding these concepts, no problems were accessibility.
reported by the expert. Therefore, the results presented above
show that, despite some details, the contents and lexical It is worth clarifying some threats to validity and how they
elements used in the CeNTER prototype are adequate and were mitigated by the team. Such examples include only one
correctly used. The adjustments suggested were already participant for expert accessibility and microcopy evaluations,
incorporated in the application. The CeNTER team highlight a giving room for improvement to conduct this study with more
lack of studies regarding the conduction of microcopy tests, participants. Also, the fact that the prototype needed an iOS
making it difficult to discuss the obtained results with the system to work was a challenge, restricting the tests to users
findings reported in the literature. Also, from the outcomes that owned this system.
achieved, it is notorious that microcopy evaluation needs a
The remote approach makes it difficult to conduct the
multidisciplinary team on software development projects
microcopy tests with the expert, since it requires a constant
aiming to build increasingly accessible software.
exchange of e-mails to clarify any doubts. Further, the remote
In addition, it is of utmost importance to test the textual test made it difficult to perform the accessibility test, since it
content with end users. As Leon [16] says, no matter how well- required the installation of the prototype in the expert’s
crafted your words are, they are only hypotheses that need to smartphone.
be validated by end-users.
Considering the results presented in this study, the
V. CONCLUSIONS following work phases will include the implementation of the
suggestions obtained from the experts’ evaluation, and the
The goal of this article was to show the main results of conduction of tests with the end-users (communities, entities,
remote accessibility and microcopy tests of a mobile networks and citizens). These will provide the necessary
application prototype, aiming to encourage interactions insights to develop a more robust, reliable and feasible version
between local agents, ease the communication and of the application, ensuring the achievements of the CeNTER
collaboration processes to promote the emergence of regional platform’s objectives.
initiatives. The evaluation enabled gathering valuable data,
involving two specialists from different areas of knowledge. ACKNOWLEDGMENT
The use of a contrast evaluation online tool allowed to identify
This article was developed under the support of the
the screen´s problems with no human intervention. The
Research Program “CeNTER” (CENTRO-01-0145-FEDER-
findings of this study helped the researchers to detect and
000002), funded by Programa Operacional Regional do Centro
overcome important accessibility issues.
(CENTRO 2020), PT2020. We are grateful for the generosity
The microcopy content evaluation allowed to verify the of Virginia Chalegre and João Paulo Silvestre, in making
terms that are more suitable according to the objectives of the themselves available to participate as evaluators, which
platform and proved that the essential terms are well applied in constitutes the basis for this study.
the CeNTER context. Therefore, the overall results were
positive, not requiring complex improvements in the CeNTER REFERENCES
prototype. This study provided a discussion about the [1] N. Komninos, “Intelligent Cities and Globalisation of Innovation
importance of using remote accessibility testing when Networks”, New York: Routledge, 2008.
developing a mobile application, contributing to the knowledge [2] L. Townsend, A. Sathiaseelan, G. Fairhurst, and C. Wallace, “Enhanced
and considering the few numbers of studies on this field. The broadband access as a solution to the social and economic problems of
the rural digital divide”, Local Economy, vol. 28(6), pp. 580-595, 1995.
moderated approach for remote tests provided immediate DOI:10.1177/0269094213496974
results, as the evaluation process occurred in real-time with the
[3] P. A. Silva, M. J. Antunes, O. Tymoshchuk, L. Pedro, A. M. Almeida,
team. As mentioned by several studies [19,20], this technique D. Renó, and F. Ramos, “Involving communities in shaping digital
allows to obtain suggestions directly from the evaluator, as solutions for innovation in societies and territories”, In ICGI’2019 –

2021 16th Iberian Conference on Information Systems and Technologies (CISTI)


23 – 26 June 2021, Chaves, Portugal
ISBN: 978-989-54659-1-0

Authorized licensed use limited to: b-on: UNIVERSIDADE DE AVEIRO. Downloaded on July 14,2021 at 09:44:37 UTC from IEEE Xplore. Restrictions apply.
International Conference on Graphics and Interaction, Faro, Portugal, Proceedings of the 17th international conference on mobile and
November 21-22, pp. 145-152, 2019. DOI: 10.1109 / ubiquitous multimedia, 305-315, November 2018.
ICGI47575.2019.8955087 [12] B. Caldwell, M. Cooper, L. Reid, and G. Vanderheiden, “Web Content
[4] P. A. Silva, M. J. Antunes, O. Tymoshchuk, L. Pedro, A. M. Almeida, Accessibility Guidelines (WCAG) 2.0”, 2008. Retrieved from
D. Renó, and F. Ramos, “Barriers and incentives to territory-based https://www.w3.org/TR/2008/REC-WCAG20-20081211/#visual-audio-
innovation processes: from technology to interaction among actors”, In contrast-contrast
Handbook of Research on Cultural Heritage and Its Impact on Territory [13] E. Nilsson, “Accessibility Evaluation of a Mobile Application Using
Innovation and Development. IGI Global, pp.44-63, 2020. DOI: WCAG 2.0 - An Evaluation of the CREDENTIAL Project’s”, Karlstad
10.4018/978-1-7998-6701-2 University, 2018, Retrieved from https://www.diva-
[5] O. Tymoshchuk, D. Reno, P. A. Silva, A. M. Almeida, L. Pedro, and F. portal.org/smash/get/diva2:1241573/FULLTEXT02.pdf
Ramos, “O papel das tecnologias digitais no desenvolvimento das
comunidades rurais: o estudo de caso múltiplo de “BioLiving” e “Bons [14] A. P. Freire, S. M. A. de Lara, and R. P. Fortes, “Avaliação Da
Sons”, Revista Portuguesa de Estudos Regionais (RPER), vol 3(52), pp. Acessibilidade De Websites Por Usuários Com Deficiência”,
131-144, 2019. Retrieved from Proceedings of the 12th Brazilian Symposium on Human Factors in
http://www.apdr.pt/siteRPER/numeros/RPER52/52.8.pdf Computing Systems, 2013.
[6] P. A. Silva, M. J. Antunes, O. Tymoshchuk, L. Pedro, A. M. Almeida, [15] K. Yifrah, “Microcopy: the complete guide”, Haifa: Nemala, 2017.
and F. Ramos, “Understanding the role of communication and mediation [16] N. de Leon, “Microcopy: discover how tiny bits of text make tasty apps
strategies in community-led territorial innovation: a systematic review”, and websites”, Kindle Edition, 2017.
Interaction Design and Architecture(s) Journal (IxD&A), vol. 44, pp. 7 – [17] S. Roberts, “Microcopy: a taxonomy and synthesis of best practices”,
28, 2020. 2017, http://www.stratonroberts.com/projects/microcopy/Microcopy.pdf
[7] D. Renó, P. A. Silva, A. M. Almeida, F. Ramos, L. Pedro, M. J. [18] J. Preece, H. Sharp, and Y. Rogers, “Interaction Design - beyond
Antunes, and O. Tymoshchuk, “Conceção de uma plataforma de human-computer interaction”, 2019, 5th ed. Indianapolis: John Wiley &
mediação digital para a Região Centro”, In proceeding de conferência Sons.
APDR 2019, pp. 1194-1199, 2019.
http://apdr.pt/data/documents/ATAS_APDRcongress2019.pdf [19] K. Moran, and K. Pernice, “Remote Moderated Usability Tests: Why to
Do Them”, 2020, http://www.nngroup.com/articles/moderated-remote-
[8] A. C. Branco, D. Carvalho, E. Sacramento, O. Tymoshchuk, E. Oliveira, usability-test-why/
M. J. Antunes, L. Pedro, M. Almeida, and F. Ramos, “Prototyping and
evaluating a mobile app to promote territorial innovation,” In [20] A. Schade, “Remote Usability Tests: Moderated and Unmoderated”,
Proceedings – Conference Communities and Networks for Territorial 2013, Retrieved July 21, 2020,
Innovation, 2021, in press. https://www.nngroup.com/articles/remote-usability-tests/
[9] S. Seifi. “Developing an Engaging Local Community Application as a [21] L. C. Serra, L. P. Carvalho, L. P. Ferreira, J. B. Silva, and A. P. Freire,
Tool for Promoting Social Integration. thesis, Malmö University”, 2019. “Accessibility Evaluation of E-Government Mobile Applications in
from http://ls00012.mah.se/handle/2043/19614 Brazil”, 6th International Conference on Software Development and
Technologies for Enhancing Accessibility and Fighting Infoexclusion
[10] M. Billi, L. Burzagli, T. Catarci, G. Santucci, E. Bertini, F. Gabbanini, (DSAI 2015), vol. 67, pp. 348–357, 2015.
and E. Palchetti, “A unified methodology for the evaluation of https://www.sciencedirect.com/science/article/pii/S1877050915031257
accessibility and usability of mobile applications”, Universal Access in
the Information Society, vol. 9(4), pp. 337-356, 2010.
[11] M. Ballantyne, A. Jha, A. Jacobsen, J.S. Hawker, and Y. El-Glaly,
“Study of accessibility guidelines of mobile applications”, In

2021 16th Iberian Conference on Information Systems and Technologies (CISTI)


23 – 26 June 2021, Chaves, Portugal
ISBN: 978-989-54659-1-0

Authorized licensed use limited to: b-on: UNIVERSIDADE DE AVEIRO. Downloaded on July 14,2021 at 09:44:37 UTC from IEEE Xplore. Restrictions apply.

You might also like