On Apr 15, 2008, at 11:23 PM, Tom Lane wrote:
> What's really a duplicate sounds like a judgment call here, so you
> probably shouldn't even think of automating it completely.
I did a consulting gig about 10 years ago for a company that made
software to normalize street addresses and names. Literally dozens of
people worked there, and that was their primary software product. It
is definitely not a trivial task, as the rules can be extremely complex.