How does one eliminate duplicates rows from a table?

Choose one of the following queries to identify or remove duplicate rows from a table leaving only unique records in the table: Method 1: Delete all rowids that is BIGGER than the SMALLEST rowid value (for a given key): SQL> DELETE FROM table_name A 2 WHERE ROWID > ( SELECT min(rowid) 3 FROM table_name B 4 WHERE A.key_values = B.key_values ); Method 2: This method is usually faster. However, remember to recreate all indexes, constraints, triggers, etc. on the table when done. SQL> create table table_name2 as select distinct * from table_name1; SQL> drop table table_name1; SQL> rename table_name2 to table_name1; Method 3: SQL> DELETE FROM my_table t1 2 WHERE EXISTS ( SELECT 'x' FROM my_table t2 3 WHERE t2.key_value1 = t1.key_value1 4 AND t2.key_value2 = t1.key_value2 4 AND t2.rowid > t1.rowid ); Note: One can eliminate N^2 unnecessary operations by creating an index on the joined fields in the inner loop (no need to loop through the entire table on each pass by a record). This will speed-up the deletion process. Note 2: If you are comparing NULL columns, use the NVL function. Remember that NULL is not equal to NULL. This should not be a problem as all key columns should be NOT NULL by definition. Method 4: This method collects the first row (order by rowid) for each key values and delete the rows that are not in this set:

SQL> DELETE FROM my_table t1 1 WHERE rowid NOT IN ( SELECT min(rowid) 2 FROM my_table t2 3 GROUP BY key_value1, key_value2 ); Note: IF key_value1 is null or key_value2 is null, this still works correctly.

1)Dyanamically creating flat files in Informatica
Asked by purushotham N | posted Jun 29 | Replies (10)

Hi I just have requirement where in, I need to generate the target files dyanamically with the department names. For example , If I have 3 departments with the names Comupers, Accounts and Finance, then We need to generate the target files as Computers.txt, Accounts.txt and Finance.txt respecivey using Informatica tool. Can any please provide the solution for this. ANSWER: Source is FILE :--empno deptno 100 10 100 20 100 30 200 10 200 20 200 20 200 10 300 10 300 10 300 10

step 1 drag and drop the columns form the source qualifier to sorter set the sort key on DEPTNO (Ascending) step 2 Drag and drop the ports to expression create ports like PORTNAME TYPE EXPRESSION


STEP3 DROP empno,DEPTNO, OUTPUT_FILE TO TRANSACTION CONTROL TRANSFORMER WRITE DECODE (OUTPUT_FILE,1,TC_CONTINUE_TRANSACTION,0,TC_COMMIT_ Before). step 4 connect to file target with the file name as deptno in target filename port.

2)Ex. 1st file AAAAAAAAAAAAAAAAAAAAAAAAAA 2nd file BBBBBBBBBBBBBBBBBBBBBBBBBB Out put is third file AAAAAAAAAAAAAAAAAAAAAAAAAA BBBBBBBBBBBBBBB BBBBBBBBBBB Now for achieving this i am using session properties with file sequential merge but i am not getting it in the third file. Even my third file is not created also after the successful Run of session. Please help me in this and pls mention the procedure that in which file i have to give merge. and do i use command in informatica session level properties. I would like to tell all of you i can not Shell Script or even any command task. as the client does't want to be done in unix. ANSWER: Why don,t you take both the files as source and merge them using union trans,and then load it to another flat file(Third file).just create another pipeline in same mapping to do that.

join of two Flat files through Informatica
Asked by bhabesh palhar | posted Dec 7, 2009 | Replies (5)

Dear All, Please suggest how to join 2 flat Files through Informatica if both have no common columns. Flat file 1- The 2 columns are Employee name & Employee Number Flt File2-The 2 columns are Department name & Department Number Regards, Bhabesh

You can also join the flat files by using a generic join condition 1=1. i.e., After the Flatfile1 source Qualifier, create an expression transformation, create an output port , JOIN_CONDITION1 with value as 1 (numeric) Do the same(JOIN_CONDITION2 ) in another expression transformation after the FlatFile2 source Qualifier. Now in the Joiner, the two pipelines can be joined on this condition using the JOIN_CONDITION1 and 2 ports. Regards, Vamsi

Sign up to vote on this title
UsefulNot useful