Professional Documents
Culture Documents
4 Technology Application
Disruption via technology will continue to be a reality for organizations and talent
development functions. Talent development professionals must have the ability to
identify, select, and implement the right learning and talent technologies that serve
the best interests of the organization and its people. Practitioners should be able to
identify opportunities to adapt and leverage the right technologies at the right time to
meet organizational goals.
1|Page
Administering a Learning Technology Ecosystem
2|Page
recovery. Maintaining regular contact with a supplier may also help TD professionals
acquire preferential terms for future contracts and participate in future planning.
All TD practitioners who are applying the technology should have a thorough
understanding of its features and functionality. This should be learned within the
context of the intended audience, the organization, and how the tool will be used.
Their understanding should be supplemented by technical documentation, which the
supplier may provide, or augmented internally based on use case. The supplier may
also provide formal training during the implementation process, which should be
leveraged by the TD practitioners who will be held most responsible for the
administration of the tool.
3|Page
TD professionals should define clear, scalable processes for all administrated
technologies. These processes should be designed to maximize the value of the
technology and protect the end user experience. TD professionals should define
their accountability for each tool and process that they consider theirs. Everything
should be documented in a shared location and regularly reviewed as the technology
ecosystem evolves.
TD professionals should ensure the viability of all content that is created, revised,
and delivered via technology platforms both during initial upload and deployment, as
well as during technology changes and updates. TD professionals should establish
content testing and revision processes that fit the needs of the organization.
Although testing should involve a variety of participants—including TD professionals,
subject matter experts, stakeholders, and end users, when appropriate—processes
should not be overly administrative or burdensome. The content’s life cycle will vary
based on topic and use, but all related processes should include considerations for
organizational changes, regulatory requirements, and technology updates.
2.4.1.8 Data Standards and Integrations (such as SCORM, AICC, and xAPI)
TD administrators should work with organizational partners, including IT, HR, and
other relevant groups, to determine integration opportunities for technology
platforms. This is especially important for a learning delivery tool—such as a learning
management system (LMS) and learning experience platforms (LXP)—as a means
of providing a simplified user and administrator experience. Initial integration
opportunities may include concepts such as single sign-on authentication and user
provisioning. Additional opportunities may include content delivery and aggregation,
data record keeping, and user interface and experience elements. All decisions
should be made with considerations for required long-term technical support to
maintain the integration (if applicable).
4|Page
TD professionals should maintain awareness of the content and data standards that
are applied within their technology ecosystem. This may include a range of
standards including:
SCORM (shareable content object reference model) 1.2 or 2004
AICC (aviation industry computer-based training committee)
xAPI (experience application programming interface)
cmi5 (computer managed instruction, fifth attempt).
A range of coding formats, such as MP4, AVI, and MOV, may also be used for video-
based content. TD professionals should apply only the formats that provide the
desired user experience and avoid unnecessary technical complexities and conflicts
between content and data formats and hardware and software tools. Care should be
taken to make sure all implemented technology supports the necessary content and
data formats. TD professionals should also maintain awareness of technical
developments within the industry that may lead to the wide-scale adoption or
decommissioning of a particular standard, such as Adobe Flash.
2.4.1.10 Accessibility
5|Page
undue burden would be imposed on the agency.” Although it can be challenging to
apply technology that is accessible to everyone, including those with cognitive,
sensory, or mobility limitations, it is an important requirement to ensure the platform
is accessible to all who need to use it. TD professionals should partner with
accessibility experts to develop guidelines for identifying, developing, applying, and
maintaining high-quality technology experiences. [See 1.6]
6|Page
lead TD professionals to consider developing custom solutions in-house if the
necessary resources are available. They may decide to run small, targeted
experiments to validate a new concept before starting a formal technology evaluation
project. Rather than waiting for the opportunity to formally pilot a potential tool, they
could quickly run an experiment using existing tools or prototypes with small sample
audiences. Feedback gathered during these experiments can help shape the
direction of the larger technology project and clarify feature requirements. [See 2.8.2]
7|Page
2.4.2.5 Stakeholder Management
Technology evaluation should include detailed interviews with stakeholders within
the intended audience, including operational partners, senior management, and end
users. This helps TD professionals understand organizational goals, beyond learning
and development. It also helps determine how the effectiveness of any new learning
technology or initiative will be measured. It’s important that the right stakeholders are
included in the final selection and approval process to ensure everyone is aligned
with the final decision and implementation plan. IT will be a key stakeholder in any
organizational technology project and must be included early in the process. [See
1.3.2, 3.2.2, and 3.2.3]
8|Page
2.4.2.8 Procurement and the RFI or RFP Process
A request for information or proposal (RFI or RFP) process is commonly used to
identify right-fit technology providers and products. Such requests should be based
on the requirements identified in the organizational analysis and focus on the desired
end user experience, rather than a list of unnecessary features. TD professionals
should use this request to challenge prospective suppliers on their ability to execute
the desired user experience. Although TD professionals should remain open to
alternative approaches, they should also remain steadfast with regard to the core
problems they are trying to solve through technology. These requirements can be
used to dictate supplier discussions, pitches, and demonstrations, as well as
stakeholder and user feedback to make the ultimate decision regarding platform
selection.
9|Page
2.4.3.2 Content and Training Modalities
Training can be delivered in a wide range of modalities, including digital modules (e-
learning), videos, classroom sessions, job shadowing, and reference materials.
When TD professionals select tools to build and deliver training, they should take
into account the mix of modalities needed throughout their organizations. TD
professionals should also consider legacy content and the need to either maintain or
develop existing materials using new tools—format compatibility for both work and
delivery files must be considered when selecting a new authoring platform.
2.4.3.5 Experimentation
E-learning authoring software is commonly licensed by the supplier to an individual
user. Therefore, the TD professional can often experiment with multiple tools quickly
and with limited expense before deploying to the entire organization. A limited
number of content developers should be tasked with testing new potential tools using
a defined process that includes creating new content and editing existing modules (if
applicable). Experimental content can be published to test users through all potential
delivery technology to ensure everything functions as expected. TD professionals
can also experiment with new tools released to the marketplace, even if they are not
considering a new implementation.
11 | P a g e
learning content to a delivery system (such as an LMS) or another database (such
as a data warehouse or LRS). TD professionals should also consider technology
reporting capabilities, including data visualizations, dashboards, and exports.
Reporting must meet both internal and external regulatory requirements as well as
desired ease of use when sharing information with stakeholders. [See 3.7.5]
2.4.5 Knowledge of Methods and Techniques for Testing the Usability and
Functionality of Learning Technologies and Support Systems
I. Methods and Techniques for Testing Usability
The purpose of usability testing is to ensure more effective learning and
development experiences for the end user. Usability testing refers to “evaluating a
product or service by testing it with representative users.” Within talent development,
usability testing may be applied to hardware devices, software platforms, or training
content during initial implementation or version updates. TD professionals
should define testing requirements for all hardware and software tools, which will
ensure that problems are identified and resolved before they can negatively impact
the intended user.
2.4.5.1 Establishing Success Criteria
TD professionals should establish clear success criteria that are based on a variety
of factors for all technology evaluation processes. First and foremost is user
experience—technology should be acquired to implement a user-friendly talent
development ecosystem that fits the needs of employees now and into the future.
Additional requirements to consider include:
12 | P a g e
Workplace context. Technology should fit the day-to-day working realities for
the end user.
Accessibility. Hardware and software must meet all regulatory and
organizational requirements regarding accessibility for all potential users.
Integrations. New tools should integrate with existing technology in formal
and informal ways.
Format and data interoperability. Content and data should be easily shared
between new and existing tools whenever possible.
Reporting and compliance. Validate compliance and whether a potential
development tool can capture and export the required data before
implementation. [See 2.4.1.9]
The evaluation success criteria should be documented and shared with all project
participants to ensure alignment and scope management.
13 | P a g e
Immediate. If the technology is the result of extreme vetting or leverages an
existing technology that is proven within the organization, it may be
implemented with the full audience immediately without additional testing.
Pilot. If the technology is implemented to a test group for a period of time, it’s
called a pilot. Upon the completion of the pilot period, the project team
reviews the results and determines whether it makes sense to continue with a
larger implementation.
Phased. A phased implementation plan for the full user audience is created
using a series of evaluation milestones. The technology is then implemented
with a select audience, and project success criteria are reviewed once the first
milestone is reached. However, unlike a pilot, the implementation does not
stop during the review. If the technology is deemed successful, it then
expands to the next audience and the milestone review process continues
until the full implementation is complete or the project is halted.
TD professionals can collect usability testing data in a variety of ways. Depending on
the product being tested, they can collect data directly from the platform or device to
analyze how users complete tasks. They may also deploy surveys or conduct
feedback discussions after the testing is complete to gather anecdotal feedback.
They should analyze all the collected data to make decisions regarding the next
steps toward implementation.
14 | P a g e
In most cases, one technology cannot provide all the support the workforce requires.
Therefore, TD professionals should have a strong knowledge of and ability to apply a
wide range of learning technologies. These tools make up the organization’s learning
technology ecosystem and enable the overall working and learning experience for
each person.
When TD professionals are involved with existing learning technologies they should
remember several requirements, although they are not specifically detailed in this
capability:
User technology experience. Consider the overall design of the user’s
technology experience. [See 2.4.2.6.]
Workplace context. Understand the day-to-day context for the end user.
[See 2.4.3.3]
Accessibility. Consider accessibility requirements. [See 2.4.1.10]
2.4.6.1 Purposeful System Selection and Integration
Learning technologies can be sorted into categories based on intended use. These
include:
Development. Tools used by TD professionals to create learning content in a
variety of modalities, including e-learning, video, documents, and imagery.
Delivery. User-facing hardware or software for accessing learning content,
including LMSs, learning experience platforms (LXP), virtual reality, adaptive
learning tools, virtual classrooms, and mobile devices.
Management. Administrative tools used to manage the storage and execution
of learning activities, such as content management systems and administrator
portals.
Social. User-facing tools that enable sharing, access, and discussion of
workplace information and learning content.
Analysis. Platforms designed to collect, store, and analyze data, such as an
LRS, data visualization tool, database, or data warehouse.
A variety of other technologies that weren’t acquired distinctly for this purpose or
managed by TD may also be used to support talent development. These may
include intranets, point-of-sale systems, customer relationship management tools,
and so forth.
Tools should be added to the organizational learning ecosystem with purpose and to
complement, rather than duplicate or complicate, existing resources. The ecosystem
should be consistently reevaluated based on the changing needs of the organization
and end users as well as improvements in the marketplace.
15 | P a g e
2.4.6.3 Strategic Tool Selection and Application
Everything should be selected and implemented with a clear purpose, including user-
facing technologies (such as LMSs) and TD tools (such as content authoring
software). As the needs of the organization change, TD professionals should
continuously evaluate the learning ecosystem to make sure the intended purpose for
each tool remains viable. Over time, some tools may take on new or additional value
while others that served their purpose will no longer be necessary.
Like consumer technology, workplace technology evolves at a rapid pace. Therefore,
TD professionals should maintain constant awareness of new products and
capabilities, even if they are not in a position to acquire or implement new
technology. This will help organizations shift forward on the technology adoption life
cycle and avoid lagging behind when it comes to the potential of learning tools.
16 | P a g e
engagement, behavior, and motivation. Many of these concepts come from well-
researched cognitive psychology but are applied in practice more quickly in
consumer tools. Similar tactics may become applicable within the organization,
especially if similar tools are introduced to support learning and performance.
However, TD professionals should always take care to apply the workplace context
to these concepts and not assume that, because something works in everyday life, it
will work the same way within the workplace. [See 3.3.10 and 2.1.5.8]
17 | P a g e
professionals should also follow all established internal guidelines and external
regulations regarding data governance and privacy when integrating systems. [See
3.1]
Communication tools are an important part of the workplace learning and support
experience. Employees use a variety of tools to communicate and collaborate within
the workflow, which supports informal learning. TD professionals may use similar
tools to communicate with their audiences and should select ones that ensure
effective message delivery as well as meaningful participant engagement. Therefore,
TD professionals should understand the platforms features and design learning
experiences that fit the capabilities of the technology.
When TD professionals apply communication technology, they should remember
several requirements that are not specifically detailed in this capability:
User technology experience. Consider the overall design of the user’s
technology experience. [See 2.4.2.6.]
Workplace context. Understand the day-to-day context for the end user.
[See 2.4.3.3]
Accessibility. Consider accessibility requirements. [See 2.4.1.10]
IT regulations and processes. Align with established IT regulations and
processes and partner with IT to develop an understanding of how they
operate before requesting project support. [See 2.4.1.2]
2.4.8.1 Types of Communication Tools
Talent development can leverage a variety of workplace communication tools to
support talent development activity. TD professionals should always develop content
that fits the specific means of delivery. For example, video and web-conferencing
18 | P a g e
tools are commonly used as online classrooms for synchronous virtual events, which
can help reach a distributed audience with a consistent, engaging message. These
platforms may be selected specifically for learning purposes or also be used for
meetings and other virtual events across the organization. TD professionals should
leverage interactive features such as chat, polls, and whiteboards, when appropriate,
to involve participants more directly in the experience. They should design an online
program based on the participants’ context, including available time, technology, and
bandwidth. Traditional classroom content should not be transferred directly to an
online setting unless it was designed for both purposes.
TD professionals may also leverage technology in the classroom to facilitate
message delivery and audience engagement. Presentation software is a ubiquitous
part of the classroom learning experience. However, like any other technology, these
tools should be used only when they add to the participant experience. Visual design
principles, such as color selection, slide layout, and font sizing, should be applied to
all presentations. Rather than using slides as a handout, TD professionals should
leverage visual presentations to support facilitated delivery and provide separate
documentation for ongoing reference. [See 2.2]
19 | P a g e
Building Learning Technology Tools
20 | P a g e
experience designs. TD professionals may also partner with UI/UX experts either
inside or outside the organization to support their continued learning and awareness
of the topic.
21 | P a g e
life cycle of an application, along with the amount of continued maintenance
requirements when deciding how to develop the program. If the organization doesn’t
have the skills or resources needed, TD professionals may contract a third-party
developer to create the program. Like new technologies and content modules,
applications should be tested using well-documented and managed review
processes. [See 2.4.5.3 and 2.4.5.4]
I. Developing AI, Machine Learning Algorithms, AR, and Other Mixed Reality
TD professionals should have a clear understanding of new technology with a
specific focus on the ethical issues of AI, AR, VR, and other mixed reality tools.
When TD professionals develop AI, machine learning, AR, and other mixed reality,
they should remember several requirements, which are not specifically detailed in
this capability:
User experience design. Study the overall design of the user’s technology
experience. [See 2.4.2.6]
Accessibility. Consider accessibility requirements. [See 2.4.1.10]
IT regulations and processes. Align with established IT regulations and
processes and partner with IT to develop an understanding of how they
operate before requesting project support. [See 2.4.1.2]
Delivery and access to devices. Remember to leverage communication
technology software that is already used within the organization for the
delivery of talent development solutions. [See 2.4.6.8]
2.4.10.1 AI Concepts, Definitions, and Use Cases
AI is typically defined as “the ability of a machine to perform cognitive functions we
associate with human minds, such as perceiving, reasoning, learning, interacting
with the environment, problem solving, and even exercising creativity” (Chui,
Kamalnath, and McCarthy 2018). AI includes two critical subdomains:
22 | P a g e
Machine learning algorithms “detect patterns and learn how to make
predictions and recommendations by processing data and experiences, rather
than by receiving explicit programming instruction.”
Deep learning is a type of machine learning “that can process a wider range
of data resources, requires less data preprocessing by humans, and can often
produce more accurate results than traditional machine-learning approaches.”
AI-enabled tools are quickly being introduced within a variety of industries and
functions. TD professionals should have a fundamental understanding of how AI and
automation affect their organizations so they can adjust their training to enable new
types of work. Knowledge of AI and machine learning also open talent development
to new learning and support strategies. TD professionals may leverage AI through a
wide range of applications, including personalized and adaptive learning, content
creation and recommendation, natural language processing, voice-activated
interfaces, digital assistants, and advanced data analysis. TD professionals should
partner with internal AI experts as well as external suppliers to determine how they
can best leverage AI in their training strategies.
23 | P a g e
2.4.10.4 Assessing AI and Mixed Reality in the Workplace
AI and mixed reality technologies may represent new components of the workplace
experience for many people. Therefore, TD professionals should assess how these
tools will alter the way people work and learn. They should also determine how to
best articulate the value of these tools to motivate people to adopt the technology
and adjust their behavior accordingly.
24 | P a g e
technology companies. TD professionals should stay up to date with these
advancements so they can properly apply them within their solutions. Talent
development should also partner with the organization’s data science and business
intelligence teams to identify additional opportunities to develop and apply custom AI
and machine learning tools. This will require considerably more data than is made
available through traditional training evaluation.
25 | P a g e
When TD professionals use e-learning software and tools they should remember
several requirements, which are not specifically detailed in this capability:
Accessibility. Consider accessibility requirements. [See 2.4.1.10]
Device compatibility. Remember to leverage communication technology
software that is already used within the organization to deliver talent
development solutions. [See 2.4.6.8]
2.4.11.1 Results-First Approach
Like any TD activity, e-learning should be applied with a results-first approach. The
focus should not be on the content itself. Rather, TD professionals should design the
right e-learning experience to achieve a clear, measurable goal for the organization.
The desired result and related knowledge and skill requirements must be identified
before any e-learning content is developed.
26 | P a g e
2.4.11.4 Media Development
E-learning content may include a range of media formats, such as images, text,
video, audio, and animation. TD professionals should consider several factors when
deciding which media elements to use within an e-learning module, such as
development timeline, available skills, delivery technology, and user context and
environment. For example, TD professionals may be able to develop a video-based
module; however, users may not be able to watch that video in the workplace if the
Internet bandwidth cannot support the content. TD professionals should try to use
the simplest solution to solve a performance problem rather than only relying on
media-rich content.
27 | P a g e
Many of the design principles applied in consumer technology are based on well-
researched cognitive psychology. Similar tactics may be applied to simplify the user
experience within an e-learning module. However, TD professionals should apply the
workplace context to these concepts and not assume that, because something works
in everyday life, it will work in the same way within the workplace.
28 | P a g e
Workplace context. Understand the day-to-day context for the end user.
[See 2.4.3.3]
Learning technology ecosystem architecture. Remember to include all HR
tools people use to support their continued development.
Accessibility. Consider accessibility requirements. [See 2.4.1.10]
Reporting. Validate that compliance and reporting capabilities are adequate.
Delivery and access to devices. Remember to leverage communication
technology software that is already used within the organization for the
delivery of talent development solutions. [See 2.4.6.8]
2.4.12.1 Consider the Outcome
As TD professionals apply technology to support talent development they should
begin with a clear and measurable organizational outcome. Rather than delivering
training for the sake of training, TD professionals determine the KSAs required to
achieve the outcome. Then, they can make an informed recommendation regarding
the technology they should use to support employee learning and development as
related to the stated goal. This approach also helps TD professionals measure the
results of their initiatives.
29 | P a g e
2.4.12.5 Learning Technology Ecosystem Architecture
TD professionals should understand their organization’s complete learning
technology ecosystem. This includes tools that were purpose-built for talent
development, such as the LMS, and other hardware and software that are used
within the user audience workflow. They can then expand their options and leverage
the right tools to address performance challenges, regardless of how the platform
was acquired or administrated. This understanding will also inform future search and
acquisition efforts, eliminating redundancy and preserving resources.
It is unlikely that a single technology will be able to support every organizational
need. Although a limited number of tools should be used whenever possible,
designing a technology ecosystem with purpose will help users easily move between
platforms without confusion.
TD professionals should understand the need for HR systems that will store and
process the right information based on the needs of the organization. They should
collaborate with HR to prevent conflicts. [See 2.4.12.3]
30 | P a g e
TD professionals should understand the capability of their HR technology tools. HR
systems may store a variety of people data (including employee demographics, job
histories, and role details) and learning data (including training completions,
assessment scores, certifications, and performance observations). Talent
development should work with HR to explore ways to integrate HR and TD
technologies and other business tools, such as systems used to track employee
performance and organizational metrics. TD professionals should only create
integration if a clear, long-term value exists.
All information stored within HR and TD systems should be regularly reviewed based
on the organization’s established content management and recordkeeping
processes. Unnecessary information, including training content and employee data
records, should not be stored long-term and may open the organization up to
additional risk. All content management practices must align with external regulatory
requirements.
31 | P a g e
integrated with more traditional learning tools, TD professionals should determine
how to create blended experiences that include social engagement.
2.4.14.4 Curation
Social technology is defined by a user’s ability to find, share, and discuss information
in a digital format. Rather than simply access on-demand content, users can engage
by commenting, adding new information, or distributing the information to additional
users. User-generated content may also take on a variety of formats, including
threaded comments, file uploads, and audio/video. These interactions may be more
synchronous or asynchronous.
32 | P a g e
Information moves quickly across these social channels, and because the work
requires consistent care, people are limited in their ability to pay attention to new
information. Therefore, TD professionals should consider applying curation tactics to
keep people involved and accessing high-value information that is shared via user-
generated content. Curation, which involves the purposeful collecting and sharing of
information to address a clear organizational need, may be conducted by TD
professionals. However, to scale information sharing at the speed of the modern
workplace, TD should enable contributors across the organization to curate
information within their domains of expertise. [See 2.5.5, 2.5.6, and 2.5.7]
33 | P a g e
2.4.15 Knowledge of Artificial Intelligence, Machine Learning Algorithms,
Augmented Reality, and Mixed Reality That Are Ethical and Free of Bias
34 | P a g e
2.4.15.2 Existing Workplace Technology Applications
Talent development is not the only workplace function that can take advantage of AI
and mixed reality technologies. For example, AI is a growing feature of workplace
automation, and mixed realities are commonly used in safety-critical environments.
They may also be used externally in customer-facing capacities. Thus, TD
professionals should collaborate with teams that are exploring these potential use
cases to establish foundational guidelines to leverage for learning applications in the
near future. They should also work with IT to understand the requirements for
introducing these technologies into the workplace, especially if other teams have not
already paved the way.
36 | P a g e