Professional Documents
Culture Documents
1
Process Highlights
Main Process
• Common Files
Sourced by every process
Ease of code maintenance
Extend new features to all processes
Developers can not alter code – maintains integrity
• Local Files
Process-specific files
Defined by Developer
Source common files
DDW Apollo - Process Automation Using Wrapper Scripts 8
File System – Common Files
• Located in /usr/local/abinitio/common
(DDW_COMMON_DIR ) on every server
• Files include
ddw_main_process.ksh chk_object_status.sql
ddw_sub_process.ksh set_object_status.sql
archive.ksh fill_job_detail_nolsn.sql
get_ora_cnt.ksh fill_job_detail.sql
get_td_cnt.ksh hosts.env
update_aslam.ksh
RUN_TYPE=P
• Runs a process by submitting an executable file such as Ab Initio
deployed graph
• Parameter required is
RUN_JOB: executable shell script that needs to be processed
RUN_TYPE=F
• Sets flags on local and target directories
• Parameters required are
FLAG_NAME: flag name
REMOTE_HOST: host server name of downstream process as in hosts.env
REMOTE_USER: useid for logging to REMOTE_HOST
REMOTE_DIR: directory on REMOTE_HOST for setting the flag
RUN_TYPE=OA
• Updates ASLAM on Oracle
• Parameters required are
OA_JOB_CODE: Job code for ASLAM on Oracle
OA_ACTION: 'START‘ or ‘FINISH’
OA_LOAD_SEQ_NUM: $LOAD_SEQ_NUM
OA_FINISH_PROCESS_NAME: run file name where OA_ACTION is
‘FINISH’
• OA_FINISH_PROCESS_NAME is required only when
OA_ACTION is START
• Two run files required – one for START and another for FINISH
Dependency Type = D
• Waits for Data files
• Format for entry
<subprocess> D <depedended file> <DEFAULT/directory location>
e.g.
build_svc_tags.run D sthsflat.sql DEFAULT
(where DEFAULT = $COLL_HOME/load_seq_num)
Dependency Type = F
• Waits for a flag set by another process
• Format for entry
<subprocess> F <depedended flag> <directory location> <remote
server> <remote userid>
e.g.
build_svc_tags.run F customer_can_${LOAD_SEQ_NUM}.1_moved.flg
$CUST_MOVED_DIR $CAN_FIN_CUST_LOAD_HOST can_svc
• Remote server parameter is as defined in
/usr/local/abinitio/common/hosts.env
Dependency Type = O
• Waits for Object Status on Oracle
• Format for entry
<subprocess> O <object_name> <subject name> <region>
e.g.
copy_girp_oh_od_all_us.run O PROD_ORDER_DETAIL
FINANCE AMER
Dependency Type = S
• Waits for another Sub-Process submitted by the same
Main Process
• Format for entry
<sub-process> S <depedended file>
e.g.
build_svc_tags.run S extract_svc_tags.run
• Required for collecting the record count for the tie-out report
• STAT_LIST_FILE parameter defines the file name
• collect_stats.ksh is used to collect record count
• File contents are not read till collect_stats Sub-Process submits
collect_stats.ksh
• Can collect record count of any of the following sources
Data Files used/generated by Ab Initio
Table on Teradata (with/without a where condition)
Table on Oracle (with/without a where condition)
• Body text file contains text that forms the body of a mail
• Log files defined inside the Ab Initio graphs have constant names
and are always replaced when the graph is re-run.
• Log files older than certain number of days
(LOG_FILE_KEEP_DAYS ) are archived and compressed by the Main
Process and copied to $AI_LOGS/archive directory.
• Archived log files older than certain number of days
(LOG_ARCH_KEEP_DAYS) are removed by the Main process.
Easy as Dell.