ISYS6308

User Experience Design

Design Testing and Development
 Design Testing with Users
Week 10.1
Overview
This session discusses some UX design techniques to help understand the needs of
the user groups, attitudes and preferences regarding the content of your site.
 Objectives Testing
Testing with
with Users
Users

o LO6. Examine the quality of UX

and integrated it to whole system
• Objectives
• Explaining the design
mock-up, and why it is
needed.
• Applying techniques and
methods for selecting
testing approach
• Make a plan Usability
testing
 Concept Exploration

– CONCEPT is generally the word used to

describe an abstract idea, such as
happiness, collaboration, or efficiency.
– In the field of UX design, CONCEPT is
used to refer to a design element that
represents one or more abstract idea of
the project team or a potential user.

• EXPLORATION
CONCEPT can be done by
individual or group UXDesign element
discussions to gather and EXPLORATION
discuss an idea with CONCEPT

various viewpoints
CONCEPT ~ abstract idea
 9 Questions for Concept Exploration and
Development

1. Who are the system stakeholders.

2. What are the system goals and objectives.
3. What is the market for this system.
4. What are the external constraints on the system.
5. What is the concept operations for the system
6. What is the system architecture context.
7. What are the man-machine interfaces to be satisfied by the system.
8. What are the key-system attributes and what are these functions
9. What must be success if the system fails to meet any of the above.

Sumber : http://www.dtic.mil/ndia/2005systems/thursday/surber2.pdf
 Difference between
Wireframes and Mockups

o A wireframe is about o A mockup is a realistic

functionality.
– A simple sketch that shows
what things were done in the
design. For example, a
wireframe of websites will
display navigation, primary
keys, columns, placement of
different elements, can be
considered as a bluprint to a
website.
representation of what the
product will look like, in this
case a website.
– The end result is called
mockup display, or a variation
after the revised version. While
some people prefer to use
graphics software, while others
directly in HTML / CSS.
 Usability Testing

• Usability testing is • Common steps

one of the most involved in usability
frequently used UX testing:
design testing 1. Choosing An Approach
2. Planning The Research
methods. 3. Recruiting And Logistics
4. Writing Discussion Guides
5. Facilitating
6. Analyzing And Presenting
Results
7. Creating Recommendations
 Usability Testing
Choosing An Approach

• QUANTITATIVE research • Testing approach

– Quantitative research is focused on
NUMERICAL DATA and is intended to
provide a high confidence with some
influenced the kinds
repetition. Quantitative research is more
scientific approach to research, with the
of skills, the type of
formalities for test design and analysis. The
focus is on design-specific assessment. access to the user, and
• QUALITATIVE research the space and the
– Qualitative research, on the other hand, do
not like to focus on the level of trust and
software necessary to
repetition, but rather on getting context and
insight into USER BEHAVIOR. A qualitative conduct the research,
approach to testing allows openness that is
conducive to explore ideas and gain insight; including the time
more important discussions with users
and budget
 Usability Testing
Planning the Research

• The plan should outline your • Why Are You Testing?

approach as chosen above : • Who Are You Testing?
– Why Are You Testing? Write a clear statement • What Are You Testing?
outlining the objectives of the test, based on
one or more of the goals of the overall project • What Information Are You
– Who Are You Testing? once you’ve created Gathering?
your user model you can use it as the basis for
your decisions on which users to test
– What Are You Testing? The question of what
you are testing includes two interrelated
questions: What method will you use to
represent the site or application, and what
tasks do you plan to include?
– What Information Are You Gathering? We’re
focusing on qualitative usability tests, which
tend to have a smaller set of measurements.
 In-Person Research
vs
Remote Research

• Factors to consider when

ENVIRONME Context
deciding whether to NTAL context. NEEDS. to
perform RESEARCH IN to examine the obtain valuable
context of the information on
PERSON or perform user's the context of
environment user needs.
REMOTE RESEARCH.
• ENVIRONMENTAL
context. ACCESS. If the COSTS.
target user is in Remote research
• Context NEEDS. another country, or if
is often regarded
they have an erratic
• ACCESS schedule, the research as less expensive
can remotely provide than in-person
• COSTS more access research.
 Steps to conduct research remotely

• Choose your TOOLS carefully. o Basic questions and evaluate

– Whatever the tool to be used must guarantee to
function properly. tools based on your answers:
• What are you ESSENTIALLY trying to DISCOVER.
• Consider the HARDWARE and • What FORMS of DATA do you need
SOFTWARE used. CAPTURED?
– If the user is at a distance, the need to ensure they • How would you like to RECRUIT USERS?
have special access to a computer. • How will participants GET to YOUR TEST?
• Who’s doing the ANALYSIS?
• TEST your SETUP before the
session begins.
– because of the way the remote is composed of various
components of the setup of equipment needs to be
tested and assessed

• Have the IT EXPERTISE.

– to anticipate in order not to be affected by user
behavior that deviates from the scope of the observed
 Usability Testing
Recruiting and Logistics

o After having outline the research and find out how many
participants from each group, it's time to perform scheduling
• Collect general information,
• Determining compensation,
• Screening,
• Space and Equipment Planning
 Usability Testing
Writing Discussion Guides

o Assemble materials needed • In summary, your test materials

for the test. There are at least
two packages: one for the
test facilitator and one set for
participants.
should include the following:
o Consent form for videotaping.
o Discussion guide for the facilitator.
o Discussion guide for participant.
o A format for note taking.
o Optionally, a questionnaire.
o The method of compensation
 Usability Testing
Facilitating

o The task of the facilitator is to introduce participants to the

process, answer their questions, and then to make sure
participants can act naturally. Make sure users think hard during
the test, as if they spoke for themselves (and gently remind them
to do so quietly). the technique of "thinking out loud" is a way of
gaining an insight into user behavior. Also, be careful not to give
the participants an answer too quickly or help answer the
questioner.
 Usability testing
Analyzing and Presenting Results

• Review the following points:

1. The amount of time you have for analysis.
2. How do your results will be used.
3. Prioritize Issue: Consequences. Recovery. Frequency of
occurrence. Rational causes.
4. Generating Insights
 Usability testing
Creating Recommendations

• Recommendations must meet the following criteria:

1. Complete more than one problem, if possible, issue
groups together under one big recommendation.
2. It will be followed up and simplified to avoid premature
design.
3. Be open to criticism, especially when the design phase
of testing.
 Conclusion : Design Testing with Users
Usability Testing USER
USER ADOPTION
ADOPTION
Personal
Personal Advantage
Advantage
Recruiting and Logistics
Support
Support
Network
Network Opinion
Opinion
Test Usability
Usability testing
Analyzing
testing
Analyzing and
and Presenting
Presenting
Invironm Results
Results
ent Test
conduct Report &
Recruitin Analyze
Planning & Presentat
g Result
Debriefin ion
g
Test Usability
Usability Testing
Testing
Materials Writing
Writing Discussion
Discussion Guides
Guides

CONCEPT Exploration Testing Approach

 Wireframes vs Mockups  In-Person Research vs Remote Research
 Transition: From Design to Development
week 10.2
Overview
In this session discussed the continuation of UX design, because the main goal is not
the design itself, the design needs to be implemented or realized as part of the WEB
or UX Applications. Here discussed options for its development, up to the
implementation plan.
 Objectives Development
Development

o LO6. Examine the quality of

UX and integrated it to whole
system
• Objectives
• Explaining the activities
after getting UX design
solutions
• Expalin the activities
after launching the
application for assure the
application.
 Visual Design, Development, and Quality
Assurance

• Ideally, each project will have a • Usability as QA

team of Quality Assurance QA,
however, in reality QA is not always – By definition, USABILITY
available. Given the UX designers, involves measurable QUALITY
information architects, interaction attributes such as ease of
designers a new profession, when learning, efficiency of use,
QA is not there, developers can and user satisfaction.
create test scripts, in some cases,
such testing wireframes to ensure
that all elements and all requests are
set to function properly. Thus, while
the QA work is handled by the UX
designer.
 Design Testing with Users…

o After a user-defined targets identified, the next Web site can be

tested at each scenario at high risk or who may have problems in
the iteration. If found significant problems during the test cycle, it
is necessary to do the test again to improve.
 Design Testing with Users…

• User Adoption is the extent o Three factors that often affect

to which the targeted end user adoption:
users who use the site or • PERSONAL ADVANTAGE
application. • SUPPORT
• User Experience also means • NETWORK OPINION
that does not stop after the
project is completed.
• The project team can help
marketing, customer
support, public relations,
and training.
 Personal Advantage

• The most important o examples:

• "By using the features of this
question to answer for camera, you can send photos
the user will be to your online accounts with
one click of a button."
"What's in it for me?"
• "By using this hiatus, the
company can more easily
keep track of time on each
project."
 Support

• In addition to contextual help, a

• What if the user
requires assistance
when interacting with
the site?
good ux design will try to
provide, answers questions as
well as training and customer
support.
 Network Opinion
• Word of mouth is the
most important in
influencing the
surroundings. Reputable
companies and websites
need to be maintained.
– You may need to reach out to the
user community and identify who
the influencers are, how they
choose to communicate, and how
they affect the audience and
engage them.
o There are many ways to
involve your users through
social networks and influence
opinion about the company
and website.
• It is worth considering how the
competition is doing to meet
the needs of the user. How to
distinguish a product or
website?
 Post launch Activities.

• The beta launch is usually • There are also mechanisms that

allow the user to report problems
obvious, the user is an
they encounter to the project team
audience for testing directly members.
from the website to help
• If designers, UX visual designers, and
identify bugs, errors, crashes developers do not know what
or other problems. happened during the beta phase,
the website can be distributed to
• During the beta phase, the users without much strategy is
method of communication is implemented.
very important to note and
report any problems that users
have.
 Post launch Strategy.

STRATEGI PELUNCURAN APLIKASI

BEFORE LAUNCH DURING LAUNCH AFTER LAUNCH

• Memilih platform : web,
mobile, android, ios
• Mengidentifikasi pengguna
dan penguji aplikasi beta
• Membuat rencana akuisisi
hasil pengujian
• Mengidentifikasi apa yang
bekerja dan apa yang tidak
• Perhatikan dan kenali
aplikasi yang berhasil
• Menganalisis tingkat retensi
pada minggu pertama
• Buat rencana untuk menarik
pengguna kembali
• Optimalkan aplikasi agar
memberikan nilai lebih
• Mengevaluasi kembali untuk
pengembangan
 Alpha vs. Beta Testing
Alpha Test Beta Test
Improve product quality, integrate
Improve product quality and ensure
What they do customer input on the finished product,
readiness beta.
and ensure the readiness of the release.
Towards the end of the development Just prior to launch, sometimes ending in
When they
process if the product is in a state of almost a few weeks or a few days before the
happen
complete. final release.
Usually very long and see many iterations. Usually only a few weeks (sometimes up
How long they
It’s not uncommon for alpha to last 3-5x to a couple of months) with few major
last
the length of beta. iterations.
Usually involves product marketing,
Who cares Almost exclusively quality/engineering
support, docs, quality and engineering
about it (bugs, bugs, bugs).
(basically the entire product team).
Normally performed by test engineers,
Who Tested in the “real world” with “real
employees, and sometimes “friends and
participates customers” and the feedback can cover
family”. Focuses on testing that would
(tests) every element of the product.
emulate ~80% of the customers.

http://www.centercode.com/blog/2011/01/alpha-vs-beta-testing/
 Alpha vs. Beta Testing
Alpha Test Beta Test
What testers Plenty of bugs, crashes, missing docs and Some bugs, fewer crashes, most docs,
should expect features. feature complete.
Much of the feedback collected is
Most known critical issues are fixed, some
How they’re considered for and/or implemented in
features may change or be added as a result
addressed future versions of the product. Only
of early feedback.
important/critical changes are made.
About chaos, reality, and imagination.
About methodology, efficiency and
Beta tests explore the limits of a product
What they regiment. A good alpha test sets well-
by allowing customers to explore every
achieve defined benchmarks and measures a
element of the product in their native
product against those benchmarks.
environments.
You have a good idea of what your
You have a decent idea of how a product
customer thinks about the product and
When it’s over performs and whether it meets the design
what s/he is likely to experience when
criteria (and if it’s “beta-ready”)
they purchase it.
What happens
Beta Test! Release Party!
next
http://www.centercode.com/blog/2011/01/alpha-vs-beta-testing/
 Post launch Analytics.

• Web site analysis may • Information "Postlaunch" may

help to understand where users
provide some insight into are having problems with
visitors to the site from highlighting trouble spots on
several aspects including: the site.
– Post-Launch Analytics To Enhance
– Who's new visitor on the site Mobile App Performance
– Who mengulangmengunjungi site » User demographic
– How many page views, Page view » Crash Reports
duration, depth Page » User Response Time and
Availability
– Where visitors exit the site: pages,
duration, session ad impressions, » Error Rates
search terms used etc. » Usability
 9 Things To Consider Before, During And After
Launching Your App
During Launch After Launch
Before Launch • Identify what’s • Create a plan
• Pick a platform working and for engaging
• Identify your what’s not and re-engaging
beta users and • Look at your users over time
test initial App • Optimize your
• Plan your Store success app to provide
acquisition • Analyze first more value
campaigns week retention • Re-evaluate to
rates grow
http://info.localytics.com/blog/9-things-to-consider-before-during-and-after-launching-your-app
 Pre-Launch App Marketing Plan
6 days before launch
• Create a landing page for your app 1 day after launch
5 days before launch o Launch Day • Launching mobile install
• Send relevant traffic to your ads using facebook
landing page • On launch day are
2 days after launch
4 days before launch advised to media • Launching the instagram
• Press coverage for your app
coverage of the sponsored posts
3 days before launch
• Create your app store description application and also 3 days after launch
and get started with app store to send an email to • Use giveaways to get
optimization thousands of downloads
all the people who
2 days before launch 4 days after launch
• Ensure that the analytics tool which provide an email • Wait a few days before
you are using to track your app is address to inform
properly setup
starting to see the
1 day before launch
you about the launch analysis and find out
• Instagram has turned out to be an of the application. where the stage of
excellent source of downloads for decline
app
http://www.business2community.com/mobile-apps/10-day-marketing-plan-launch-app-
01131191#MLZwROWFtPbqm2rw.99
o Reference
Russ Unger and Carolyn Chandler. 2012. A Project Guide to UX Design: for User
Experience Designers in the Field or in The Making. New Riders. Berkeley, CA.
ISBN:978-0-321-81538-5
Jesmond Alen and James Chudley, (2012), Smashing UX Design : Foundations for
Designing Online User Experiences, John Wiley & Sons Ltd., West Sussex,
PO19 8SQ.
http://thenextweb.com/dd/2013/08/10/13-ways-to-master-ux-testing-for-your-startup/
http://msdn.microsoft.com/en-us/magazine/dd882523.aspx
http://www.dtic.mil/ndia/2005systems/thursday/surber2.pdf

TERIMA KASIH
 Overview UX

10. UX Design Testing and Development

1. 2.
3.
UX Design Business
User Research
Methodology Requirement

7. 8.
4. 5.
6. SITE WIREFR
CREATIN CONTEN 9.
DESIGN MAPS AMES
G T PROTOT
PRINCIP AND AND
PERSON STRATEG YPING
LE TASK ANNOTA
A Y
FLOWS TIONS