Statistics

Machine learning

Record linkage

Chemistry

Data modeling

Database

Artificial intelligence

Linkage (software)

Biochemistry

Data integration

Population

Mathematics

Gene

Political science

Operating system

Data mining

Demography

Computer science

Process (computing)

Sociology

Transfer of learning

Key (lock)

End-to-end principle

Matching (statistics)

Obstacle

Computer security

Fuzzy logic

Entity matching (EM), also known as entity resolution, fuzzy join, and record linkage, refers to the process of identifying records corresponding to the same real-world entities from different data sources. It is an important and long-standing problem in data integration and data mining. So far progresses have been made mainly in the form of model improvements, where models with better accuracy are developed when large amounts of training data is available. In real-world applications we find that advanced approaches can often require too many labeled examples that is expensive to obtain, which has become a key obstacle to wider adoption.

Auto-EM: End-to-end Fuzzy Entity-Matching using Pre-trained Deep Models and Transfer Learning