new and deleted records created for successive runs...

Apr 23, 2010 at 12:22 AM

If I start with an empty dim and load it up using the Kimball SCD component, it loads all customer recs as expected via the "New" row output.

Now, if I immediately re-run the component, it identifies 99% of the rows as unchanged, but then passes 374 rows as "New" rows and 374 rows as "Deleted".

I've tried this experiment several times and always the same. Any suggestions. What kind of info would you need from me to help debug the issue?


Apr 23, 2010 at 12:27 AM

It appears that different hash algorithms produce different "new/deleted" sets, but there are always X new rows and X deleted rows on the SCD output on successive runs.

Apr 23, 2010 at 3:38 PM

My bad. I set the OLE DB SRC component output as "sorted" on the business key without adding an "order by" clause in the data select statement.