Professional Documents
Culture Documents
====================
-> Project - Domain
-> Project Flow
-> Roles and responsibilities
-> Tech and tools
-> project duration
Project
--------
1. check your old projects
know your domain - retail, banking, finance, insurance,hotel mgt,healthcare,
telecom etc
pre-req
-------
1. Unix (basics)
2. sql/plsql
3. DWH concepts
dwh?
diff schemas?
dwh & data mart?
metadata?
1-> Business requirement /roadmaps => seniors invovled/ arch/ business analyst
2-> Infra required -> db size, how many dev , tester , time line etc
3-> Data ?
a> data is provided by client through flat files which is | delimited.
it will be provide on FTP.
b> the files are validated before it is downloaded on to our FTP.
c> THe data is loaded to our database (external tables, sql loaders, UTL file
packages)
-> to tables (you)
d> data validation at raw data table-> count of rows in file and table; required
columns are with data;
e> staging -> data inserted to tables with constraints, index, synonymns, sequences
etc.
ETL
J> Data profiling -> understanding the data (context,format,informations,schema, ER
diagram)
K> automation and scheduling - > automation tool and frequency (weekly)