skip to main | skip to sidebar

Learned Knowledge Informatica

information that posted are those issues or information that required during my project implementation.

Wednesday, August 8, 2007

Distinct & duplicate records to 2 different targets

Problem :
source is flat file which contains duplicates,we have 2 targets in the mapping,we need to pass unique records to one target & records which is repeating(duplicates) to another target.
can anyone please tell how we can achieve this.

Solutions 1:
Sort the data. Create a field in an Expression that counts the duplicate rows by comparing it to the previous row. Use a Router with two groups: where count=1 and where count >1.

Solution 2 :
put an aggregator transformation and do group by all ports and add a count(*) function in another output port and based on count(*)>1 or =1 you can use router to divert the distinct and duplicate records.

Solutions 3:
u can also pass all duplicate records.
by following these steps:

1. take sql qualifier with sorted input checked on.
2.pass all rows to aggregator , n do group by all
ports, and take on port (count(*))
3. take another sql qualifier ,
4. use joiner with full outer join n join 2 & 3. with
condition (port matching)
5. take 2 filters to separate duplicate row & distinct
rows.. based on condn: count(*)>1 n count(*)=1 and
pass it to respective targets.
at 3:53 PM

No comments:

Post a Comment

Newer Post Older Post Home
Subscribe to: Post Comments (Atom)

History

  • ►  2015 (2)
    • ►  June (2)
  • ►  2014 (1)
    • ►  January (1)
  • ►  2013 (2)
    • ►  September (1)
    • ►  July (1)
  • ►  2012 (5)
    • ►  October (1)
    • ►  September (1)
    • ►  August (2)
    • ►  March (1)
  • ►  2011 (1)
    • ►  November (1)
  • ►  2010 (6)
    • ►  March (6)
  • ►  2008 (14)
    • ►  November (1)
    • ►  September (1)
    • ►  May (3)
    • ►  April (3)
    • ►  March (5)
    • ►  February (1)
  • ▼  2007 (6)
    • ►  September (1)
    • ▼  August (5)
      • Oracle : Truncate Table in Procedure
      • Connected v/s Unconnected Transformation
      • Distinct & duplicate records to 2 different targets
      • Data Mart Migration from sql server to oracle Db
      • bind: (WSAEADDRINUSE)Address already in use

FEEDJIT Live Traffic Feed