Duplicate Detection: Resources

• Workshops
  • KDD-2003 Workshop on Data Cleaning, Record Linkage, and Object Consolidation
  • IJCAI-2003 Workshop on Information Integration on the Web (IIWeb-03)
  • IJCAI-2003 Workshop on Learning Statistical Models from Relational Data (SRL-2003)
  • The US Bureau of Census Record Linkage Techniques 1997 Workshop
  • The US Bureau of Census Record Linkage Techniques 1985 Workshop
• Software
  • SecondString - an open-source Java-based package of approximate string-matching techniques.
  • SimMetrics - another open-source Java-based library of similarity metric techniques.
  • MARLIN - a Weka-based Java package for duplicate detection. Currently in the process of being cleaned up, please contact mbilenko@cs.utexas.edu if you would like to receive the current version.
  • Febrl (Freely Extensible Biomedical Record Linkage) does data standardisation (segmentation and cleaning) and probabilistic record linkage ("fuzzy" matching) of one or more files or data sources which do not share a unique record key or identifier.
  • The Link King - a freely downloadable record linkage application for SAS.
• Projects, seminars, courses
  • Object Matching in Data management seminar at the University of Washington, Fall 2004.
  • Parallel Large Scale Techniques for High-Performance Record Linkage project page at Australian National University.

Last modified: August 25, 2003