University of Toronto

Faculty of Applied Science and Engineering

APS112 & APS113
Conceptual Design Specification (CDS)

Project # 130 Date March 22, 2019

Project Title Bixby Project 311

Client Name Geoff Wong

Client Contact James Han

Tutorial Section Tut 0126

Teaching Assistant Pranav Kadhiresan

Prepared By James Han 1004789044

(Names and Student #s
of Team Members)
Arshia Shirbani 1004809086
Jinglun Zhao 1004928206
Jesryl Calalang 1004912981
Aryaman Kamath 1004788839
Ambrose Man 1004937189

Please check off which components you are submitting for your assignment:
_✔_ CDS in one Google document (file) with a PDF copy submitted to Quercus with the following components

_✔_ Cover Page _✔_ Alternative Designs

_✔_ Executive Summary _✔_ Proposed Conceptual Design
_✔_ Introduction _✔_ Measure of Success
_✔_ Problem Statement _✔_ Conclusion
_✔_ Detailed Requirements _✔_ Reference List
_✔_ Service Environment _✔_ Appendices (Optional)
_✔_ Stakeholders

_✔_ Include a link (with “can edit” access) to your Google document in the Comments section of your Quercus
submission.

If any of the above components are missing, your assignment is considered incomplete. It will accrue standard late
penalties until completed.

**Attribution table with ALL team members’ signatures must be submitted in hard copy in the tutorial of the
assignment debrief. An incomplete or missing attribution table will result in zero on the assignment for the team.**
Engineering​ ​Strategies and Practice

Executive Summary

This report generates the foundations for a Bixby Capsule to report two types of public maintenance
issues (PMIs): potholes and graffiti. Bixby is a Samsung platform that allows third party developers to
create capsules for specific purposes. In designing a Bixby Capsule for Samsung, there are client imposed
constraints and Samsung standards and policies to adhere to when determining a solution. There currently
exist applications which use Open311 API to report PMIs. However, no Bixby Capsules are able to
complete this function.

The primary function is to provide a method to report PMIs to Open311. Since reporting is a choice for
the user, the objectives aim to make reporting using the Bixby Capsule quick and straightforward.
However, for the capsule to be workable for Open311, the accuracy of the location reported must be, at a
minimum, on the correct street. As reporting can be performed while driving, the objective of minimizing
distracted driving is important. Although wireless communication is legal, Samsung has taken initiatives
to address this matter, such as their app, In-Traffic Reply.

The project scopes the capsule to operate in Toronto, mainly while the user is walking or driving since
that is when an individual would most likely encounter PMIs. Consequently, many factors must be
considered; the most prominent being the surrounding environment and network. Since Bixby operates
through speech, the surrounding environment, which is influenced by several factors, heavily impacts
Bixby’s ability to recognize the user’s voice. The network is indispensable as Bixby must connect to the
Open311 database.

While this capsule aims to help the citizens of Toronto report PMIs, there are other parties affected as
well. These include automobile users and cyclists, in addition to organizations responsible for the removal
of PMIs. The impact of this design on these stakeholders must be considered when determining whether
the design conforms to the scope.

Following, our design process resulted in us choosing the Voice to Map solution, as it was the best suited
design according to the decision matrix. This suggests that it was the design which was closest to
achieving the chosen objectives. Furthermore, a prototype capsule can be created based on this design,
and tested according to tests mentioned in the Measures of Success section. These tests will represent a
situation closest to that experienced by future day-to-day users of the capsule.

1
Engineering​ ​Strategies and Practice

1.0 Introduction

Samsung’s open-source conversational assistant, Bixby, is found in several devices, including the
Samsung Galaxy Note 9. The Bixby Platform allows third party developers to create capsules to teach
Bixby about certain use cases for user interaction and conversation [1].

Open311 is an application program interface (API) that tracks public space issues [2]. It is an open-source
platform that allows developers to use the API in their applications. The document focuses on how a
Bixby capsule could improve on existing 311 solutions and the user experience whilst reporting PMIs.
Giving particular attention to the shortcomings of existing apps, the team used benchmarking to formulate
relevant objectives to create a more user-friendly design.

2.0 Problem Statement

Our client, Samsung, requests a Bixby Capsule that reports PMIs, specifically potholes and graffiti.
Potholes are “[holes] in the surface of a roadway” [3]. Damage done to cars by potholes leads to
substantial costs; repairing potholes is a cost effective way of keeping roads in good condition. [4].

Graffiti is another issue Toronto faces. According to the Legislative Assembly of Ontario, graffiti is any
design or writing on any public surface [5]. Graffiti negatively affects property value and business
opportunities [6].

Reporting PMIs mitigates their negative effects and prevents further property damage. The Public
Administration Review states that the 311 service through smartphones has resulted in increased reports
in the city of Boston [7]. Lower income groups, in particular, are more likely use a 311 smartphone
application rather than 311 [7]. The report also states that smartphone applications will increase reporting
from the youth [7]. Furthermore, Open311 claims that the API collects and shares information on PMIs
more efficiently [2].

Currently, several public maintenance applications exist. SeeClickFix allows users to take pictures of
PMIs and report the location but may be dangerous for users who are driving or are unable to access their
camera [8]. Street Bump is an app that automatically records potholes but can result in accidental
reporting [9]. Alternate methods for reporting PMIs include; online forms and contacting 311 by phone
[10]. These methods of reporting require the user to go through many steps [Appendix C]. By using
Bixby, a conversational assistant, the reporting process can be more engaging [11].

Currently, there are no conversational assistants that report PMIs to the Open311 API. Therefore, the need
is for a Bixby Capsule to report PMIs. PMIs are mostly encountered while the user is walking or driving
in Toronto [12]. The scope of this project is to transmit information to Open311 through the Bixby
Platform while the user is walking or driving in Toronto. Providing evidence of PMIs is outside the scope.
As set by the client, the end users are those who use the Samsung Galaxy Note 9.

2
Engineering​ ​Strategies and Practice

3.0 Detailed Requirements

Data transmission occurs in two steps in this capsule: from user to Bixby, followed by Bixby to the
Open311 API. Objectives are focused on performance, favouring user comfort. Furthermore, some
constraints pertain to the limitations of the Bixby Platform, while others relate to benchmarking previous
methods of reporting.

3.1 Functions

The functions focus on reporting PMIs to Open311 using Bixby. They were generated using the black
box, functional basis, and functional decomposition methods [see Appendix A].

Table 1: Primary Function

Primary Function

1. Transmit information on PMIs to Open311

Table 2: Secondary Functions

Secondary Functions

1. Activate Bixby

2. Confirm successful transmission of user report

3. Request details of report

4. Recognize command words related to reporting of PMIs only

5. Relay information pertaining to PMIs to Open311 API

3.2 Objectives

The Bixby Capsule is a method for people in Toronto to report PMIs to Open311. As filing a report is a
choice, the design is focused to be user-centered. Therefore, the objectives are centered around being
quick and convenient. Using the pairwise comparison method [see Appendix B], objectives pertaining to
speed and convenience ranked higher. Objectives are ranked in decreasing order of importance with their
respective importance.

3
Engineering​ ​Strategies and Practice

Table 3: Objectives
Objective Metrics Objective goal Importance

Should require Number of user Less than 10 steps. From an external case study, it was
minimal steps to inputs. determined that more fields tends to
file a PMI discourage users from completing
report. online forms[13]. Furthermore,
benchmarking [see Appendix C] was
done to establish a limit for the
number of steps (10).

Should require Three states: Does not require any Not everyone in Toronto knows all
no knowledge of requires no knowledge of local the street names. Also, looking at the
local street information on street names. upcoming street sign is inconvenient
names in street names, for the user.
Toronto. obtain street
names from
looking at
upcoming street
intersection, and
must know the
street name from
memory.

Should provide Average distance Average width of a The GPS on smartphones are accurate
accurate from actual two-lane street is 6 - to within 4.9m [15]. The speed of
locations. location. 7m [21] (lane width * vehicle and delay time between the
2). activation of Bixby and the report
being filed decreases accuracy.

Should minimize Time users take Not require users to Although Ontario laws allow
distracted their eyes off take their eyes off the hands-free wireless usage [16], taking
driving. road for. road. eyes off the road can increase the risk
of accident to drivers by 24 times
[17].

4
Engineering​ ​Strategies and Practice

3.3 Constraints

The following constraints arise from various sources:

Table 4: Constraints
Constraint Justification

Must use Open311 API. Needed to deliver information from the capsule to the Open311
database [18].

Sensors used by mobile device Bixby is intended to perform as a conversational tool [19];
are limited to microphone and however, the user can still interact with the screen.
GPS.

Must be developed for Samsung Client-imposed.

Note 9.

Reports must take at most 23 Out of the three methods of reporting potholes [See Appendix C],
steps. the constraint matches the absolute maximum number of steps.

4.0 Service Environment

This capsule is set to operate in Toronto. The following sections will include information about the
physical, living and virtual conditions within this environment.

4.1 Physical Environment

The following reflects environmental data in Toronto, conditions in which users may use this application.

Table 5: Physical Environment of Toronto

Environmental Elements Range

Temperature (​o​C​) -24.6 - 35.4 [20]

Lane Width (m) 3 - 3.5 [21]

Visibility (km) 19 - 22 [22]

Average Noise Level (dBA) 57.5(nighttime) - 64.1(daytime) [23]

Vehicles 1.1 million in total and 1.3 vehicles per property [24]

5
Engineering​ ​Strategies and Practice

4.2 Living Environment

Living beings include those that can influence the application while using it.

Table 6: Living beings found in the environment

Living Beings

Population (0 - 14 years: 16.3%, 15 - 64 years: 69.1%, 65 - 84 years: 14.6%) [25]

Hackers (hackers are after email and physical addresses, also credit card information) [26]

Road Maintenance Personnel (roads are inspected and resurfaced every 20 years) [27]

4.3 Virtual Environment

Virtual environmental data describes the software and network conditions in which the capsule will
function.

Table 7: Virtual environment the design will take place in

Category Requirements

Operating Platform Android, Blackberry, iPhone[28]

Network WIFI (IEEE 802.11)[29]

Speech Recognition System Bixby

Mobile Data Coverage Bell, Rogers and Freedom Mobile provide 100% LTE coverage in
Toronto[30]

5.0 Stakeholders
The stakeholders below are those most impacted by the implementation of this design:

Table 8: Stakeholders
Stakeholder Impact of Design

Automobile/motorbike users in Running over a pothole is equivalent to a collision at 35 mph

Toronto. [17]. Therefore, automobile and bicycle users will benefit from
a safer driving environment following the simple and efficient
Cyclists in Toronto. reporting and repairing of potholes.

Organizations responsible for the Public and private organizations are hired to fix PMIs.

6
Engineering​ ​Strategies and Practice

mending of PMIs. Approximately 78,000 potholes were repaired in 2017 [31], and
134,000 in 2018 [32]. Following the creation of this Bixby
Capsule, reports will increase, as the capsule is a convenient
means of reporting PMIs, resulting in potentially greater
revenue for contractors who are able to keep up with the higher
volume.

City of Toronto. The city possesses a specific management plan when dealing
with graffiti; supporting art which adds ‘vibrancy to Toronto’s
streets [33]. Therefore, authorities will need to choose if the
reported graffiti is a form of vandalism. This takes additional
time, and may reduce the efficiency of responses to service
requests.

6.0 Alternative Designs

In order to successfully design a Bixby capsule which provides users with a convenient method
of reporting PMIs, a design flow chart was created to show the possible alternatives for each
procedure followed by the capsule when reporting to the API. The minimum information
required by the API include: location of PMI and the type of service request. It is important to
note a service request for a pothole and graffiti is satisfied by the same data type
(‘address_string’ and ‘Lat and Long’) [34].

Activating Bixby is constrained by the Samsung Galaxy Note 9. The list of command words to
open the correct capsule is not a part of the design because the capsule should recognize the
broadest range of terms relating to reporting potholes and graffitti. In the case of all three
designs, if the user does not provide enough information, Bixby will use voice to inquire more.

As a result, our alternative designs focus on requesting the user’s location. For all three designs,
if location services is on, the report is automatically filed. The subsequent phase of brainstorming
involved listing possible methods of obtaining location information. This involved a free
brainstorming session to diverge in creating solutions involving voice, maps, and combinations
of the two.

As a note, a step in the following designs is defined as an action that the user takes, following an
action by Bixby.

7
Engineering​ ​Strategies and Practice

6.1 Voice to Map

Bixby will ask whether or not users are driving, which yields two outcomes.

Outcome 1: Not driving

The user provides a street or intersection.
Bixby displays a map of that area. The user
can navigate the map and place a marker on
their location. After, the user confirms the
location which finalizes the report.

Outcome 2: Driving

The user verbally communicates the

name of a nearby intersection. Then,
Bixby displays a map with nine
numbered locations near the provided
intersection. The locations cover the next
intersection as well as the halfway point
between the current intersection and the
next. The user then says which number is
closest to the PMI, and proceeds to
confirmation through voice.

8
Engineering​ ​Strategies and Practice

Flowchart A: process when user isn’t driving

Flowchart B: process when user is driving

9
Engineering​ ​Strategies and Practice

Table 9 - Voice to Map Correlation with Objectives

Objective Description

Should require minimal steps A minimum of three[See Appendix D] meets our

to file a PMI report. objective.

Should require no knowledge The non-driving alternative requires only a street with
of local street names in the driving oriented design requiring an intersection.
Toronto. This information can be obtained from looking at the
upcoming street signs, therefore this design fails our
objective goal; however, this design does not require
the user to recall the street name for memory.

Should provide accurate
locations.
The user can differentiate whether the PMI is on first
half, middle, or second half of the road. The average
city block is 80m[35]. Therefore, the divided sections
are 0-40,20-60,40-80. The overlap accounts for the
error when deciding borderline situations, thus the
maximum error is 40 metres; however, it could have 0
error. Therefore, the objective varies when meeting this
objective.

Should minimize distracted This objective is not met because the user is required to
driving. look at the location options displayed on the screen.

6.2 Voice Commands

The reporting process is the same for both while driving, and not. Bixby requests the location of
the PMI, and the user will name the intersections ahead and behind them. Next, Bixby will
request a verbal confirmation of the provided location. In each part of Bixby’s conversations, the
Bixby design guide [36] is employed to ensure Bixby’s dialog is professional and helpful.

10
Engineering​ ​Strategies and Practice

Flowchart C: capsule’s process

Table 10 - Voice Commands Correlation with Objectives

Objective Description

Should require minimal steps Minimum two steps[See Appendix D], thus it satisfies
to file a PMI report. this objective.

Should require no knowledge Does not meet the objective because without
of local street names in knowledge of street names, users must look for signs of
Toronto. intersections ahead and behind them.

Should provide accurate The average city block is 80 metres, thus defining the
locations. potential error [35]. Hence, the objective is not met.

Should minimize distracted Objective is met as mobile screen is not in operation,

driving. and the user can pay attention to driving.

11
Engineering​ ​Strategies and Practice

6.3 Landmark to Map

This design depends on whether or not the user is driving.

Outcome 1: User is not driving:

The user verbally communicates a nearby
landmark and intersection. Bixby then displays a
map with visual markers of all landmarks within a
1km radius of the provided intersection.
Furthermore, the user can explore the map. The
user clicks the button to confirm.

Outcome 2: User is driving:

Unlike the design in Outcome 1, the user can not explore on the map due to a legal constraint set
by the Ontario Government [16]. The user will vocally communicate which landmark they are
currently beside and then Bixby will ask for a confirmation.

Flowchart D: capsule functions while the user is driving and not driving

12
Engineering​ ​Strategies and Practice

Table 11 - Landmark to Map Correlation with Objectives

Objective Description

Should require minimal steps Minimum three steps[See Appendix D], meeting this
to file a PMI report. objective.

Should require no knowledge This objective does require the user to either know the
of local street names in street names or requires them to find out by observing
Toronto. the street sign; consequently, not meeting this
objective.

Should provide accurate
locations.
Since the landmark may be placed closest to the
intersections, the minimum accuracy is one full block
(80m). In the best scenario, the pothole is right beside
the landmark, thus this design varies in meeting the
objective goal.

Should minimize distracted The user is required to look at the location options on
driving. the screen thus failing this objective.

7.0 Proposed Design

The team used a decision matrix to value the more important objectives and determine the
proposed design (in depth process in Appendix E).

7.1 Proposed Conceptual Design

In order to better the city’s image and provide safer roads, the team proposes the Voice to Map
design. As reporting is voluntary, our top objectives focus on user convenience. Additionally,
accuracy is important to Open311. This design provides the most accurate location to a
maximum error of an estimated 40 meters. It is accessible to users as street names can be
obtained off signs. Furthermore, the design factors in whether or not the user is driving, thus
striving to minimize distracted driving. These objectives can be tested through our proposed
design tests.

Overall, the design fulfills the client’s need by sending the location of a PMI to Open311 API.
Increased convenience will result in a greater number of reports, which ultimately results in a
higher standard of Toronto.

13
Engineering​ ​Strategies and Practice
8.0 Measures of Success
The team will create a prototype capsule to test the objectives. To do so, the team assigned
Ambrose and Arshia the lead positions on coding. The team’s faculty will also provide resources
to develop the voice to map prototype. Therefore, the team has outlined proposed tests to
measure how well the design matches the objectives.
Table 12 - Proposed Tests to Measure Objectives
Objective Proposed test
Should require Once the correct capsule has been
a minimal activated, the team records the number
steps to file a of steps (definition of step in objective
PMI report. section).
Should require Allow users who have no knowledge
no knowledge and users who know all the street
of local street names to perform reports. Records of
names in successful reports and time required
Toronto. will be kept.
Should provide This value was estimated to having a
accurate potential error of 40m and a potential
locations. of providing the exact location
(explained in the alternative design). To
analyze this, the team will record the
distance between location reported and
in reality.
Should A simulation of distracted driving will
minimize use a test subject to stare at a far away
distracted object. The prototype will be in the test
driving. subject’s peripheral vision as they try to
file a report. We will be able to see
when the individual diverts their
attention away from the focus point.
We will record the number of times the
individual looks away from the focal
point and the length of time.
Importance of data
Comparing the number of steps of
this design compared to current
methods of reporting provides and
indication of whether or not this
method is faster.
If the number of successful reports
decreases or time required
increases by a significant amount
(computation through Chi-squared
test), it will demonstrate the failure
of the design to conform to this
objective.
Creating a graph of all the
displacements allows for analysis
on general trends, average
displacement, and maximum error.
The average of the values within
one standard deviation of the mean
(avoid outliers) will be considered
the accuracy of the design.
The increase in time required to
look at the phone is an indicator
that the design does not satisfy this
objective. Any physical interaction
with the phone asides from
activating Bixby will be considered
a failure.
14
Engineering​ ​Strategies and Practice

9.0 Conclusion

In determining that the Landmark to Map design best matches our objectives, the prototype is to
be developed for the final presentation on April 15, 2019. This design allows Samsung Note 9
users to report holes and graffitti using Bixby. Our overall design will allow for a more
convenient way to report potholes and graffitti to benefit the city of Toronto.

15
Engineering​ ​Strategies and Practice

10.0 References

[1] Bixby Developers. ​The Art and Science of Training,​ 2019. [Online] Available at:
https://bixbydevelopers.com/dev/docs/dev-guide/developers/training.NL-and-Training [Accessed
8 Feb. 2019].

[2] Open311. ​What is Open311?, 2​ 019 [online] Available at: http://www.open311.org/learn/

[Accessed 8 Feb. 2019].

[3] Ontario.ca. (2019). ​Law Document English View​. [online] Available at:
https://www.ontario.ca/laws/regulation/020239 [Accessed 15 Feb. 2019].

[4] Pothole.info. ​Damages From Potholes,​ May. 25, 2009. [Online]. Available:
https://www.pothole.info/2009/05/damages-from-potholes/ . [Accessed Feb. 8, 2019].

[5] Legislative Assembly of Ontario. (2019). ​Graffiti and Advertising Signs Control Act, 2002​.
[online] Available at:
https://www.ola.org/en/legislative-business/bills/parliament-37/session-3/bill-205 [Accessed 15
Feb. 2019].

[6] Toronto Police. “Graffiti Prevention and Control”, July, 2007. [online] Available at:
http://www.torontopolice.on.ca/community/graffiti/factsheet.pdf [Accessed 14 Feb. 2019].

[7] UNCW. ​Coproduction of Government Services and the New Information Technology​. 2019
[Online] Available at:
https://uncw.edu/bbwc/brudney/documents/CoproductionofGovernmentServicesandtheNewInfor
mationTechnologyBrudney2013.pdf [Accessed 8 Feb. 2019].

[8] thestar.com. (2019). ​Mayor Rob Ford promotes smartphone apps to automatically report graffiti |
The Star​. [online] Available at:
https://www.thestar.com/news/gta/2012/04/18/mayor_rob_ford_promotes_smartphone_apps_to_a
utomatically_report_graffiti.html [Accessed 14 Feb. 2019].

[9] "About Street Bump", ​Streetbump.org​, 2019. [Online]. Available:

http://www.streetbump.org/about. [Accessed: 01- Mar- 2019].

[10] Toronto, C., Payments, S., Streets, P. and Maintenance, R. (2019). ​Potholes​. [online] City of
Toronto. Available at:
https://www.toronto.ca/services-payments/streets-parking-transportation/road-maintenance/pothol
es/ [Accessed 14 Feb. 2019].

[11] ​N. Alam, "Automate the Boring Task: The Horizon of Conversational Assistants", ​Towards Data
Science,​ 2018. [Online]. Available:
16
Engineering​ ​Strategies and Practice

https://towardsdatascience.com/automate-the-boring-task-the-horizon-of-conversational-assistants
-b13a9d859c02. [Accessed: 01- Mar- 2019].

[12] Marchesan, J. (2019). Underfunding, bad repairs, cited for poor pothole repairs. [online]
CityNews Toronto. Available at:
https://toronto.citynews.ca/2019/01/12/underfunding-bad-repairs-cited-for-poor-pothole-repairs/
[Accessed 14 Feb. 2019].

[13] D. Kirkpatrick, "Lead Generation: Testing form field length reduces cost-per-lead by $10.66 -
MarketingExperiments", ​MarketingExperiments​, 2011. [Online]. Available:
https://marketingexperiments.com/lead-generation/lead-generation-testing-form-field-length-redu
ces-cost-per-lead-by-10-66. [Accessed: 01- Mar- 2019].

[14] E. Vaportzis, M. Clausen, and A. J. Gow, “Older Adults Perceptions of Technology and Barriers
to Interacting with Tablet Computers: A Focus Group Study,” ​Frontiers in Psychology​,
04-Oct-2017. [Online]. Available:
https://www.frontiersin.org/articles/10.3389/fpsyg.2017.01687/full. [Accessed: 01-Mar-2019].

[15] Gps.gov. (2019). ​GPS.gov: GPS Accuracy​. [online] Available at:

https://www.gps.gov/systems/gps/performance/accuracy/ [Accessed 14 Feb. 2019].

[16] Ministry of Transportation, “Distracted Driving,” Government of Ontario, Copyright

2012-2019. [Online]. Available: https://www.ontario.ca/page/distracted-driving. [Accessed Feb.
8, 2019].

[17] J. Moyles, "Potholes Cause Serious Car Accidents", ​Hg.org.​ [Online]. Available:
https://www.hg.org/legal-articles/potholes-cause-serious-car-accidents-34887. [Accessed: 14-
Feb- 2019].

[18] "Bixby Developers", ​Bixbydevelopers.com​, 2018. [Online]. Available:

https://bixbydevelopers.com/dev/docs/dev-guide/developers/training.intro-training. [Accessed:
15- Feb- 2019].

[19] ​Samsung, “Enhancing User Experience by interacting with Bixby.” Unpublished material.
APS112: Engineering Strategies and Practice II, University of Toronto, Toronto, ON., Canada.
2019.

[20] “Temperature - Annual data for Toronto,” Amateur Weather Statistics for Toronto, Ontario.
[Online]. Available: https://toronto.weatherstats.ca/charts/temperature-yearly.html. [Accessed:
14-Feb-2019].

[21] https://www.toronto.ca/wp-content/uploads/2017/11/9986-ecs-specs-roaddg-Lane_Widths_
Quick_Reference_Version_2.0_Jun2017.pdf. (2019)

17
Engineering​ ​Strategies and Practice

[22] “Climate & Weather Averages in Toronto, Ontario, Canada,” ​timeanddate.com​. [Online].
Available: https://www.timeanddate.com/weather/canada/toronto/climate. [Accessed:
14-Feb-2019].

[23] https://www.toronto.ca/legdocs/mmis/2017/hl/bgrd/backgroundfile-104525.pdf

[24] “How many cars are on the road in Toronto?,” ​blogTO​. [Online]. Available:
https://www.blogto.com/city/2014/07/how_many_cars_are_on_the_road_in_toronto/. [Accessed:
14-Feb-2019].

[25] ​Table 1.a Proportion of workers commuting to work by car, truck or van, by public transit, on
foot, or by bicycle, census metropolitan areas, 2011.​ [Online]. Available:
https://www12.statcan.gc.ca/census-recensement/2016/dp-pd/prof/details/page.cfm?Lang=E&Ge
o1=POPC&Code1=0944&Geo2=PR&Code2=35&Data=Count&SearchText=Toronto&SearchTy
pe=Begins&SearchPR=01&B1=All&GeoLevel=PR&GeoCode=0944&TABID=1
https://www.holiday-weather.com/toronto/averages. [Accessed: 14-Feb-2019].

[26] “How Hackers Violate Your Privacy,” ​PrivacyPolicies.com Blog​, 19-Jan-2018. [Online].
Available: https://privacypolicies.com/blog/stop-hackers/#attacks-on-individuals. [Accessed:
14-Feb-2019].

[27] City of Toronto, “Sidewalks & Roads,” ​Green Lane Landfill,​ 06-Dec-2017. [Online]. Available:
https://www.toronto.ca/services-payments/streets-parking-transportation/road-maintenance/road-s
idewalk-repair/. [Accessed: 14-Feb-2019].

[28] City of Toronto, “Open311 API and Mobile Apps,” ​Green Lane Landfill,​ 23-Jan-2018. [Online].
Available:
https://www.toronto.ca/home/311-toronto-at-your-service/open311-api-and-mobile-apps/.
[Accessed: 14-Feb-2019].

[29] Tutorialspoint.com, “Wi-Fi IEEE Standards,” ​www.tutorialspoint.com.​ [Online]. Available:

https://www.tutorialspoint.com/wi-fi/wifi_ieee_standards.htm. [Accessed: 14-Feb-2019].

[30] Whistleout.ca. (2019). ​Best Cell Phone Coverage In Toronto.​ [online] Available at:
https://www.whistleout.ca/CellPhones/Guides/Best-coverage-In-Toronto [Accessed 14 Feb.
2019].

[31] K. Connor, "Pothole season keeps crews busy", ​Toronto Sun​, 2017. [Online]. Available:
https://torontosun.com/2017/04/22/pothole-season-in-to-keeps-crews-busy/wcm/5424c71d-7e59-
4ec7-9209-c414905d6783. [Accessed: 15- Feb- 2019].

18
Engineering​ ​Strategies and Practice

[32] N. Staff, "A city of potholes: Crews have filled around 134,000 in Toronto", ​CityNews Toronto,​
2018. [Online]. Available: htps://toronto.citynews.ca/2018/05/02/toronto-potholes/. [Accessed:
15- Feb- 2019].

[33] "Graffiti Management", ​City of Toronto,​ 2019. [Online]. Available:

https://www.toronto.ca/services-payments/streets-parking-transportation/enhancing-our-streets-an
d-public-realm/graffiti-management/. [Accessed: 14- Feb- 2019].

[34] "​ GeoReport v2", ​Wiki.open311.org,​ 2019. [Online]. Available:

https://wiki.open311.org/GeoReport_v2/. [Accessed: 22- Mar- 2019].

[35] ​"City Blocks differ in size", ​Land4ever.com,​ 2019. [Online]. Available:

http://www.land4ever.com/block.htm. [Accessed: 22- Mar- 2019].

[36] Bixbydevelopers.com. (2019). ​Bixby Developers​. [online] Available at:

https://bixbydevelopers.com/dev/docs/dev-guide/design-guides/writing [Accessed 22 Mar. 2019].

19
Engineering​ ​Strategies and Practice

8.0 Appendix

8.1 Appendix A

Function Generation using the Black Box method, functional basis, and functional decomposition

Table 9: Black Box method

Type Input Outputs

Information -User’s knowledge on a public -Information regarding position,

maintenance issue
type, and other details about
public maintenance issue
-Confirmation of report being
received relayed back to the user
-Warning message to user to
make sure they’re reporting the
public maintenance issue in a
safe manner (not while driving
or blocking traffic)

Mass None None

Energy -Sound energy from user to -Confirmation of report being

report a service received via audio notification
-(possibly other forms of energy
if the screen turns on)

Functional Basis: Transmit information

Functional Decomposition:
Report information about a pothole or graffitti
- Activate Bixby
- Activate the correct Bixby Capsule

- Receive audio input

- Bixby interpret audio input
- Interaction between user and Bixby to place a report

20
Engineering​ ​Strategies and Practice

8.2 Appendix B

Table 10: Pairwise comparison of objectives

Should be Should Should be Should provide Should Points
quick to only easy to accurate report minimiz Received
file a require learn locations e
report a few distracte
words d driving
to
activat
e the
correct
capsul
e

Should be N/A 1 1 1 1 4
quick to file
a report

Should only 0 N/A 0 0 0 0

require a
few words
to activate
the correct
capsule

Should be 0 1 N/A 1 1 3
easy to learn

Should 0 0 0 N/A 1 2
provide
accurate
report
locations

Should 0 1 0 0 N/A 1
minimize
distracted
driving.

21
Engineering​ ​Strategies and Practice

8.3 Appendix C

Self testing to find benchmark values.

Self Test of 311 Phone Call Report (procedural description):

1. The phone dialling app was opened

2. 3-1-1 was dialled
3. A selection was made on the dial pad made pertaining to the exact type of PMI to be reported
4. Provide first and last name to the representative
5. Provide location of the pothole
6. Provide phone number
7. Describe the shape of the pothole to the representative
8. Describe the size of the pothole
9. Describe the approximate depth of the pothole
10. Describe the approximate location of the pothole (relative to nearby objects)

The entire process took 10 steps

Self Test of 311 Website Report:

1. The safari browser was opened on the iPhone

2. Toronto’s 311 website was navigated to
3. The ‘Roads’ service request selection was made
4. The ‘report minor pothole damage’ selection was made
5. Confirmation of the pothole being on a city road was made
6. Confirmation of the pothole being a ‘standard pothole’ was made
7. Confirmation of the pothole not being an immediate safety hazard was made
8. The terms of use agreement was agreed to
9. The ‘Next’ button at the bottom of the page was clicked
10. Street number was inputted
11. Street name was inputted
12. Street type was inputted
13. Street direction was inputted
14. Further location details were inputted
15. Appropriate title of user was chosen
16. First name was inputted
17. Last name was inputted
18. E-mail address was inputted
19. Phone number was inputted
20. The ‘Next’ button at the bottom of the page was clicked
21. The size and shape of the pothole was described

22
Engineering​ ​Strategies and Practice

22. The ‘Next’ button at the bottom of the page was clicked
23. The details were submitted, and the request was successfully made

The entire process took 23 steps

Testing of the See Click Fix app:

1. Downloaded the See Click Fix application

2. Made a See Click Fix account by providing your e-mail and setting a password
3. Confirmed account creation by opening confirmation email
4. Opened the See Click Fix mobile application
5. Submitted new request
6. Added and selected photo (captured or taken from photo library)(optional)
7. Reported location using the interactive map
8. Found category of PMI by scrolling through a provided list
9. Filled out form which requests contact details, and a description of the PMI
10. Submitted report

The entire process took 10 steps.

BrainStorming
Activate Bixby:
1. Bixby button where you hold it down
2. Say “Hi Bixby”

Information dealing with location.

Required: Avenue and Street
Optional: What is around you, closer to a certain intersection, landmark close

Solutions:
1. Voice: Bixby asks user
2. User manually types in location information
3. Location services, would be automatic
4. Google map street view of surrounding
5. Google map identify nearby building/landmark
6. Display a map and the user clicks where it is
7. Combination 6 then 2 (6, for general location, 2 for accuracy)
8. List of possible intersection with known street
9. ​User inputs a landmark the pothole is near, Bixby confirms the landmark by showing the user
multiple similar landmarks so the user can choose the correct one
10. Known street, list of possible address numbers (Yonge St. XXX)
11. Voice: Bixby asks user for intersection
12. Voice: Bixby ask user for address number

23
Engineering​ ​Strategies and Practice

13. List of possible postal codes - ask user to fill in exact postal code (fill in the blanks)
14. List nearby transit stops
15. Ask user to turn on user services

Methods to confirm:
1. Voice description of what user said
2. Image on google maps
3. Location in words on screen
4. Google street view
5. Voice description of what exact location and local landmark
6. Button that confirms report

Description of pothole/graffiti
Required: size of both
Optional: graffiti what it looks like, depth of pothole

Solutions:
1. Voice descriptions
2. Type on screen to enter dimensions
3. Picture with dimensions and the user can manually adjust the image
4. User prompts a image(voice or typing) and Bixby prompts an image and the user can confirm if it
resembles what they see
5. Small circle with dimensions, as user holds down screen and the circle enlarges and user lets go when it is
the size of the pothole they see
6. Manually draw the graffiti (sketch)
7. Display multiple images of generic potholes and graffiti and the user can swipe to find the most matching
one
8. Search up an images on google and then the user manually select
9. Use the phone as a “magic wand” they draw a circle with their phone and that is how large the pothole is
10. You have a bar and the user swipes to how large it is (in area).
11. Shake your phone, the more aggressive and fast, the larger the pothole.
12. User holds down finger on screen, more pressure (force touch) would mean bigger pothole.

Confirm successful transmission:

1. Words from Bixby
2. Sound (not words) from Bixby
3. Vibration on phone
4. Screen lights up
5. Display words on screen
6. Camera flash
24
Engineering​ ​Strategies and Practice

Recognize command words:

1. Potholes
2. Grafitti
3. PMI
4. Public matientice issue
5. 311
6. Street art
7. Hole
8. Ground
9. Report

Capsule Design Flow

1) REQUESTS
Activate Bixby (set by phone)
a) Voice - “Hi Bixby”
b) Bixby Button (hardware on phone)
2) MOMENTS
- 3 main types of Moments
- 1) Dialogue
- 2) Display on screen
- 3) Follow up - action button, conversation driver etc.

a) Input moment - occurs after any user request

- 3 main methods of input moment
- 1) Selection
- Bixby displays a list of addresses to specify location
-
- Card
- Text
- Compound card
- 2) Elicitation
- Bixby asks again for more information
- Bixby displays a question -> possible answers shown in a list below
question
-
- 3) Pickers
- Bixby displays pictures of the environment
- Bixby displays a map of the location
- Displays street name, but has a selection for building number
- For example: Yonge St. identified -> display a dial, clicker or
25
Engineering​ ​Strategies and Practice

something that lets the user choose a number between 1-X

-
-
- Autocomplete - use in the case of not enough input
- Single Line

b) Confirmation moment - used when there are important actions or transactions

i) Conversation
- Recite information
ii) Display Content
- Location (text, maps,
- Time submitted (Date, time,
- Shape and size of PMI (text)
iii) Action (Button etc.)
- Confirm using button - Confirm or Cancel
c) Result moment - delivers on the user’s goal

i) Voice
ii）Check mark on the screen
iii) Providing a receipt
- Summary of the transaction
iv) Providing details
- Location of pothole
- Time submitted of the report
- Shape and size of PMI
v) Providing choices
- List, max of 3 highlights shown, can click for more results if wanted by user
- Words
- Images

8.4 Appendix D
Number of steps for each design

1.Voice to Map
3 steps​. Driving:
1. User provides an intersection.
2. User vocally communicates a number of where they are that Bixby displays (explained in
alternative design).
3. User confirms report through voice.
3 steps​ Non driving
1. User provides street or intersection.
2. User explores the map.
3. User selects a location they wish to report and click the confirm button.
2. Voice Commands

26
Engineering​ ​Strategies and Practice

- 2 steps​;
1. User provides 2 intersection locations verbally (one forward and one behind)
2. User confirms the report verbally.

3. Landmark to Map
- 3 steps​; Driving
1. User provides a landmark and an intersection
2. User vocally selects the numbered landmark in which they are closest to.
3. User confirms the report orally.
3 steps:​ Non-driving
1. User provides a landmark and an intersection.
2. User explores map.
3. User selects which landmark they are closest to and confirms the report.

8.5 Appendix E
In deciding the proposed design, the team used the following scale while using the decision
matrix.

Description of Design Matching Objectives

0% Does not meet objective.

20% Poorly meets the objective.

40% Adequately meets the objective.

60% Proficient meets the objective.

80% Greatly meets the objective.

100% Fully meets the objective.

The team discussed in determining the value for “Value”, and assigned higher percentages for
the more important objectives.

Decision Matrix
Design Value Voice to Voice Landmark
Requirements Map Commands Locator
and Criteria
27
Engineering​ ​Strategies and Practice

Should require 40% 60% 80% 60%

minimal steps to
file a PMI report.

Should require no 30% 60% 20% 60%

knowledge of
local street names
in Toronto.

Should provide 20% 80% 20% 40%

accurate
locations.

Should minimize 10% 40% 80% 40%

distracted
driving.
Total Summation of Value 0.62 0.50 0.54
multiply Percentage

28