You are on page 1of 37

HCM

Data Loader (HDL)


Advanced Topics

Prasanna Borse
Oracle HCM Cloud Center of Excellence
June, 2017

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 2


HDL Advanced Topics
1. Overview
2. Architecture
3. Supported Keys
4. Date Effective Updates
5. Full vs Partial History
6. Duplicate Person Check
7. Multiple Assignments
8. Post Conversion Programs
9. Considerations for Legal Entity Setup in Coexistence
10. Useful Apps
11. FBL2HDL
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 3
Overview

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 4
What is HCM Data Loader?
Inbound Bulk Integration Solution

• Inbound Oracle Fusion HCM Bulk Integration Solution.


• Loads bulk data from any source
• Supports business objects for many Oracle Fusion HCM products,
including:
- Global Human Resources - Global Payroll
- Compensation - Talent
- Absence Management - Profile Management
- Performance Management - Time and Labor
- Workforce Management

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 5


Comprehensive Object and Data Type Support

Business Objects Document Attachments Business Object support


across the product family
Global Human
Global Payroll Compensation
Resources
Bulk loading of:
Absence Time and
Talent
Management Labor
• Flexfield Data
Performance Profile Workforce
Management Management Management • Person Images
Flexfield Data Translation Data • Documents of Record
Attachments
• Translation Data
• Department and
Person Images Tree Hierarchies Organization hierarchies

Moon Corporation

Production Finance Marketing Sales

Research Development QA Hardware Applications

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 6


Processes Compressed ‘Zip’ Files
METADATA|Job|SourceSystemOwner|SourceSyst
emId|EffectiveStartDate|EffectiveEndDate|
Name|JobCode|ActiveStatus|SetId|Language
MERGE|Job|PSFT|14112342|2010/01/01|4712/1
2/31|Accountant|ACC101|A|202|USM
ETADATA|JobGrade|SourceSystemOwner|Source

• Zip files can contain:


SystemId|JobId(SourceId)|EffectiveStartDa
te|EffectiveEndDate|GradeId
MERGE|JobGrade|PSFT|14112312341|14112342|
2010/01/01|4712/12/31|1842

– One or more business object


files
– Attachments
– Files of Large Object data
• Zip files can be encrypted

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 7


Accepts Files from Oracle WebCenter Content Server
METADATA|Job|SourceSystemOwner|SourceSyst
emId|EffectiveStartDate|EffectiveEndDate|
Name|JobCode|ActiveStatus|SetId|Language
MERGE|Job|PSFT|14112342|2010/01/01|4712/1
2/31|Accountant|ACC101|A|202|USM
ETADATA|JobGrade|SourceSystemOwner|Source

Upload to Oracle WebCenter


SystemId|JobId(SourceId)|EffectiveStartDa
te|EffectiveEndDate|GradeId
MERGE|JobGrade|PSFT|14112312341|14112342|

Content server via:


2010/01/01|4712/12/31|1842

• User interface
• Web service

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 8


HCM Data Loader Supported Business Objects
Global HR Extended Lookup Grade Step Translation Department Tree Node Checklist Template
Extended Lookup Translation Grade Rate Organization Tree Checklist Translation
Legislative Data Group Grade Rate Translation Organization Tree Node Checklist Task Translation
Legislative Data Group Translation Grade Ladder Document Type Worker
Action Reasons Grade Ladder Translation Document Type Translation Person Contact
Action Reasons Translation Step Rate Translation Name Format Person Contact Relationship
Actions Job Family Person Type Person Disability
Actions Translation Job Family Translation Person Type Translation Schedule Assignment
Calendar Event Job Legislative Data Group Security Profile Absence Case
Calendar Event Translation Job Translation Organization Security Profile Allocated Checklist
Resource Exception Organization Country Security Profile Document Record
Location Organization Translation Position Security Profile Document Record Delivery Preference
Location Translation Position Document Type Security Profile Areas of Responsibility
Grade Position Translation Person Security Profile Delegated Role
Grade Translation Department Tree Role Mapping
Global Payroll Element Entry
Talent Education Establishment Rating Category Translation Content Item Rating Description Goal
Education Establishment Translation Rating Level Translation Translation Goal Plan
Rating Model Content Item Talent Profile Goal Plan Set
Rating Model Translation Content Item Translation Talent Profile Translation Talent Pool
Content Items Relationship Talent Pool Translation
Compensation Salary Basis Salary

Absences Person Accrual Detail Person Entitlement Detail Person Absence Entry
Time and Labor Time Record Group

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 9


HCM Data Loader Benefits

• Increased Object Coverage • User Experience


– Absences – Error Management
– Talent Objects – Easy navigation and reconciliation of data
– Oracle Time and Labor – Comprehensive yet clear status and record count
– HR: Security Profiles, Checklists information
– Attachment and person image support – Business Object whitepapers delivered to provide
– All descriptive and extensible flexfields supported targeted data loading guidance

• Process Improvements • Architecture Improvements


– No requirement for a cross reference file – Metadata driven architecture and new objects can
– Data created through the UI can be updated by User be added easily
Key – Easy formatting of data file for readability and
extracting data from multiple sources
– Parallelization of non dependent objects and
intelligent sequencing of dependent objects

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 10


Process Flow (UI)

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 11
Bulk Data Loading Process Flow
- Review supported business objects and hierarchical shape
- Initiate file
- Transform and extract data in Oracle HCM Cloud business object shape
- Review status and messages
- Generate zip file

Source System

HCM Cloud

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 12


Importing and Loading your Compressed Zip Files
Automated User Managed
When When
• Ongoing regular and incremental updates • Data Migration
How • One-off updates
• Web-service call to upload file to Oracle How
WebCenter Content server
• Import and Load Data page
• Web-service call to submit file for processing with – Select and submit file
HCM Data Loader
– Monitor progress
• Web-service call to run status report in HCM – Review messages and errors
Extracts – Correct attribute values for failed objects
– Resubmitt failed records

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 13


User Managed Processing
Select a file from the
WebCenter Content
server, or a local file
Specify action:
• Import only
• Import and load
Monitor progress
Review messages and
failed records
Correct attribute values
Initiate Load
Navigation: Data Exchange - Import and Load Data

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 14


Monitor Progress
The page is divided into:
Data Sets
• A data set is created for
each zip file you submit for
processing

Business Objects
• A business object is created
for each dat file with a valid
name supplied in your zip
file (data set).
Navigation: Data Exchange - Import and Load Data

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 15


Progress Icons

Not ready (locked) The process cannot be started, it is dependent on another process completing.
Ready The process is ready to start.
In Progress The process is running.
Completed Successfully The process completed with no errors or warning raised.
Completed with Warnings The process completed but warnings were raised.
Completed with Errors The process completed but errors were raised.
Stopped The process has been manually stopped.
Messages exist Messages exist, click the icon for more details.

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 16


Record Counts
Available at Data Set and
Business Object levels

Counts for file lines Imported


and Objects generated and
processed

Non-zero Failed counts


navigate to Error Management

Navigation: Data Exchange - Import and Load Data

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 17


Reviewing Messages
Review summary of
messages raised
Number of occurrences of
each message provided
Message summary can be
extracted to spreadsheet

Navigation: Data Exchange - Import and Load Data - Messages (icon)

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 18


Error Management
Review failed record details:
• Attributes
All attributes available and the values
supplied
• Source System Reference
Any references supplied against the data
line
• Physical Row
The data line as provided in the file

Update attribute values by clicking


Edit

Navigation: Data Exchange - Import and Load Data - Failed (count)

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 19


Status and Error Reporting
Data Set Summary Data Set Status
Machine readable status and summary for a specific data set User friendly output to analyze complex errors

• Available from HCM Extracts • User friendly output to analyze complex errors for
a specific business object, record, or message
• XML machine readable format
• Available from Diagnostic Framework
• Output can be customized
• Includes
• Can be invoked by web-service call
– Status
• Includes – Record counts (file line and object)
– Status – ESS process information
– Record counts (file line and object) – SET and METADATA lines supplied
– Error messages raised – Message text with stack trace
– Identifiers to all records impacted by each error – Failed and unprocessed record identifiers

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 20


Business Objects
-Hierarchy
-File Shape
-Commands

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 21
Understanding the Business Object Shape
Business Object Hierarchies

• Hierarchical shape of business object


components
• One more child business object
components
• Supports
– Multiple child occurrences
– Ability to load child components
independently

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 22


Understanding the Business Object Shape: Job
Child Components

• Hierarchical shape Job

• Made of up one of more business object


components Job Valid Grade

Job Evaluation

Job Extra Information

Job Legislative Extra


Information

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 23


Understanding the Business Object Shape: Job
Component Attributes
Attributes
Job Attributes
Attributes
• Set of attributes to hold data for the component
• Unique key for the record Attributes
Job Valid Grade
Attributes
• For child components
– Unique key to the parent record Job Evaluation Attributes

Job Extra Info Attributes

Job Legislative
Attributes
Info

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 24


Understanding the Business Object Shape: Job
Component Attributes
Job
EffectiveStartDate
EffectiveEndDate
JobCode
SetCode
Job Legislative
Name Job Valid Grade Job Evaluation Job Extra Information
JobFamilyId Information
JobFamilyName EffectiveStartDate JobCode EffectiveStartDate EffectiveStartDate
ActiveStatus
EffectiveEndDate SetCode EffectiveEndDate EffectiveEndDate
FullPartTime
GradeCode EvaluationCriteria JobCode JobCode
JobFunctionCode JobCode DateEvaluated SetCode SetCode
ManagerLevel SetCode EvaluationSystem SequenceNumber SequenceNumber
MedicalCheckupRequired KnowHow JeiInformationCategory JeiInformationCategory
RegularTemporary Accountability FLEX:PER_JOBS_EIT_EFF FLEX:PER_JOBS_LEG_EFF
BenchmarkJobFlag MeasuredIn EFF_CATEGORY_CODE EFF_CATEGORY_CODE
BenchmarkJobCode ProblemSolving InformationType InformationType
ProgressionJobCode
… …
ApprovalAuthority
ActionReasonCode

25
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Understanding the Business Object Shape: Job
Component Attributes
Attributes
Job Attributes
Attributes
• Supports
– Supplying child records independently Attributes
Job Valid Grade
Attributes

Job Evaluation Attributes

Job Extra Info Attributes

Job Legislative
Attributes
Info

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 26


Example Job.dat
COMMENT Create Accountant Job
METADATA|Job|EffectiveStartDate|SourceSystemOwner|SourceSystemId|Name|JobCode|ActiveStatus
|Set|Language
MERGE|Job|2010/01/01|VISION|103|Accountant|ACC|A|FIN|US
METADATA|JobGrade|EffectiveStartDate|SourceSystemOwner|SourceSystemId|JobId(SourceSystemId
)|GradeCode|SetCode
MERGE|JobGrade|2010/01/01|VISION|235|103|AC1|FIN
MERGE|JobGrade|2010/01/01|VISION|238|103|AC2|FIN
MERGE|JobGrade|2010/01/01|VISION|241|103|AC3|FIN
MERGE|JobGrade|2010/01/01|VISION|233|103|AC4|FIN

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 27


Supported File Line Instructions
SET FILE_ESCAPE , SET
Override default behavior.

COMMENT Job Maintenance File COMMENT


Ignored, for user readability.
METADATA|Job|JobCode|SetCode|EffectiveStartDate|Effective
EndDate|ActiveStatus|Name
METADATA
Defines components and attributes included in the file. Remove
attribute names if not supplying values.

MERGE|Job|SE|COMMON|2000/01/01||A|Software Engineer MERGE


MERGE|Job|ACC|COMMON|2000/01/01||A|Accountant Unique identifier for the record being maintained along with
values to be added to Oracle Fusion.

DELETE|Job|AC1|COMMON|||| DELETE
Unique identifier for the record to be deleted.

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 28


METADATA Instruction
COMMENT Create Accountant Job Each DAT file must have at least one
METADATA|Job|EffectiveStartDate|SourceSystemOwner|Sourc METADATA line
eSystemId|Name|JobCode|ActiveStatus|Set|Language
METADATA defines the components and
MERGE|Job|2010/01/01|VISION|103|Accountant|ACC|A|FIN|US
attributes included
METADATA|JobGrade|EffectiveStartDate|SourceSystemOwner|
SourceSystemId|JobId(SourceSystemId)|GradeCode|SetCode Only include a METADATA line for the
MERGE|JobGrade|2010/01/01|VISION|235|103|AC1|FIN components you have data for
MERGE|JobGrade|2010/01/01|VISION|238|103|AC2|FIN Only specify the attributes you are
MERGE|JobGrade|2010/01/01|VISION|241|103|AC3|FIN supplying values for
MERGE|JobGrade|2010/01/01|VISION|233|103|AC4|FIN

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 29


MERGE Instruction
COMMENT Create Accountant Job Include the component discriminator
METADATA|Job|EffectiveStartDate|SourceSystemOwner|Sourc after the MERGE instruction
eSystemId|Name|JobCode|ActiveStatus|Set|Language
MERGE lines appear after the
MERGE|Job|2010/01/01|VISION|103|Accountant|ACC|A|FIN|US
METADATA line for the component
METADATA|JobGrade|EffectiveStartDate|SourceSystemOwner|
SourceSystemId|JobId(SourceSystemId)|GradeCode|SetCode Supply attribute values in the order
MERGE|JobGrade|2010/01/01|VISION|235|103|AC1|FIN you defined them in the METADATA
MERGE|JobGrade|2010/01/01|VISION|238|103|AC2|FIN
line
MERGE|JobGrade|2010/01/01|VISION|241|103|AC3|FIN
MERGE|JobGrade|2010/01/01|VISION|233|103|AC4|FIN

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 30


SET and COMMENT Line Structure
SET line format
SET <parameter> <value>
Example:
SET FILE_DELIMITER ,

COMMENT line format


COMMENT <comment>
Example:
COMMENT New job definitions with date effective history

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 31


SET Instruction
SET FILE_DELIMITER <new value> Must be placed at the top of the dat
file
Used to override default settings
SET FILE_ESCAPE <new value>

SET FILE_NEW_LINE <new value>

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |


SET Instruction.. continued
SET PURGE_FUTURE_CHANGES <Y/N>

SET DISABLE_POST_PROCESS_TASKS <ESS Program>


SET DISABLE_POST_PROCESS_TASKS RefreshManagerHierarchy
SET DISABLE_POST_PROCESS_TASKS UpdatePersonSearchKeywords

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |


File Line Order
SET FILE_DELIMITER | COMMENT Create Accountant Job
COMMENT Create Accountant Job METADATA|Job|EffectiveStartDate|SourceSystemOwner|S
METADATA|Job|EffectiveStartDate|SourceSystemOwner|S ourceSystemId|Name|JobCode|ActiveStatus|Set|Languag
ourceSystemId|Name|JobCode|ActiveStatus|Set|Languag e
e METADATA|JobGrade|EffectiveStartDate|SourceSystemOw
MERGE|Job|2010/01/01|VISION|103|Accountant|ACC|A|FI ner|SourceSystemId|JobId(SourceSystemId)|GradeCode|
N|US SetCode
COMMENT Valid Grades for Job Accountant MERGE|Job|2010/01/01|VISION|103|Accountant|ACC|A|FI
METADATA|JobGrade|EffectiveStartDate|SourceSystemOw N|US
ner|SourceSystemId|JobId(SourceSystemId)|GradeCode| COMMENT Valid Grades for Job Accountant
SetCode MERGE|JobGrade|2010/01/01|VISION|235|103|AC1|FIN
MERGE|JobGrade|2010/01/01|VISION|235|103|AC1|FIN MERGE|JobGrade|2010/01/01|VISION|238|103|AC2|FIN
MERGE|JobGrade|2010/01/01|VISION|238|103|AC2|FIN MERGE|JobGrade|2010/01/01|VISION|241|103|AC3|FIN
MERGE|JobGrade|2010/01/01|VISION|241|103|AC3|FIN MERGE|JobGrade|2010/01/01|VISION|233|103|AC4|FIN
MERGE|JobGrade|2010/01/01|VISION|233|103|AC4|FIN

SET command to be supplied before any METADATA line


METADATA line to appear before the first MERGE line for that component

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 34


Business Object ‘dat’ File Format - Summary

COMMENT Create Accountant Job • Business object hierarchy specific. For


METADATA|Job|EffectiveStartDate|SourceSystemOwner|So example:
urceSystemId|Name|JobCode|ActiveStatus|Set|Language • Job
MERGE|Job|2010/01/01|EBS- • Worker
UK|103|Accountant|ACC|A|FIN|US • Salary
METADATA|JobGrade|EffectiveStartDate|SourceSystemOwn
er|SourceSystemId|JobId(SourceSystemId)|GradeCode|Se
• Named for the hierarchy it contains data
tCode for, for example Location.dat, Worker.dat
MERGE|JobGrade|2010/01/01|EBS-UK|235|103|AC1|FIN • Pipe-delimited
MERGE|JobGrade|2010/01/01|EBS-UK|238|103|AC2|FIN
• Flexible
MERGE|JobGrade|2010/01/01|EBS-UK|241|103|AC3|FIN
MERGE|JobGrade|2010/01/01|EBS-UK|233|103|AC4|FIN
• Each line starts with an instruction
• Definition and data lines contain a
component discriminator

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 35


HCM Data Loader Documentation
User Guide and Business Object white papers
1664133.1
HCM Data Loader: User Guide
• User guide: All the information covered in
this training is available in this guide.
• Automating HCM Data Loader white
paper

2020600.1
HCM Data Loader: Business Object
Documentation
• Lists supported business objects
• Provides links to business object white papers.

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 36

You might also like