Abstract:Multipartite entity resolution aims at integrating records from multiple datasets into one entity. We derive a mathematical formulation for a general class of record linkage problems in multipartite entity resolution across many datasets as a combinatorial optimization problem known as the multidimensional assignment problem. As a motivation for our approach, we illustrate the advantage of multipartite entity resolution over sequential bipartite matching. Because the optimization problem is NP-hard, we apply two heuristic procedures, a Greedy algorithm and very large scale neighborhood search, to solve the assignment problem and find the most likely matching of records from multiple datasets into a single entity. We evaluate and compare the performance of these algorithms and their modifications on synthetically generated data. We perform computational experiments to compare performance of recent heuristic, the very large-scale neighborhood search, with a Greedy algorithm, another heuristic for the MAP, as well as with two versions of genetic algorithm, a general metaheuristic. Importantly, we perform experiments to compare two alternative methods of re-starting the search for the former heuristic, specifically a random-sampling multi-start and a deterministic design-based multi-start. We find evidence that design-based multi-start can be more efficient as the size of databases grow large. In addition, we show that very large scale search, especially its multi-start version, outperforms simple Greedy heuristic. Hybridization of Greedy search with very large scale neighborhood search improves the performance. Using multi-start with as few as three additional runs of very large scale search offers some improvement in the performance of the very large scale search procedure. Last, we propose an approach to evaluating complexity of the very large-scale neighborhood search.

On an application of multidimensional arrays

Method of the Multidimensional Sieve in the Practical Realization of some Combinatorial Algorithms

On Recurrence Relations of Multi-dimensional Sequences

Characteristic Matrices of Compound Operations of Coverings and Their Relationships with Rough Sets

An Introduction to Multisets

Combinatorial Algorithms for Multidimensional Necklaces

A Representation of Binary Matrices

Multidimensional Assignment Problem for multipartite entity resolution

A New Algorithm for Updating and Querying Sub-arrays of Multidimensional Arrays

Difference Covering Arrays and Pseudo-Orthogonal Latin Squares

On the algebra generated by three commuting matrices: combinatorial cases

Searching Monotone Multi-dimensional Arrays

Deinsum: Practically I/O Optimal Multilinear Algebra

Enumeration of points, lines, planes, etc

Analysis and Computation of Multidimensional Linear Complexity of Periodic Arrays

On simultaneous similarity of families of commuting operators

Associative Arrays: Unified Mathematics for Spreadsheets, Databases, Matrices, and Graphs

Towards Conceptual Multidimensional Design in Decision Support Systems

Criteria of valid line sum arrays for multidimensional matrices

Complexity and equivalency of multiset dimension and ID-colorings

Families of Multidimensional Arrays with Good Autocorrelation and Asymptotically Optimal Cross-correlation