Parallel Frequent Item Set Mining with Selective Item Replication

Abstract : We introduce a transaction database distribution scheme that divides the frequent item set mining task in a top-down fashion. Our method operates on a graph where vertices correspond to frequent items and edges correspond to frequent item sets of size two. We show that partitioning this graph by a vertex separator is sufficient to decide a distribution of the items such that the subdatabases determined by the item distribution can be mined independently. This distribution entails an amount of data replication, which may be reduced by setting appropriate weights to vertices. The data distribution scheme is used in the design of two new parallel frequent item set mining algorithms. Both algorithms replicate the items that correspond to the separator. NoClique replicates the work induced by the separator and NoClique2 computes the same work collectively. Computational load balancing and minimization of redundant or collective work may be achieved by assigning appropriate load estimates to vertices. The experiments show favorable speedups on a system with small-to-medium number of processors for synthetic and real-world databases.
Type de document :
Article dans une revue
IEEE Transactions on Parallel and Distributed Systems, Institute of Electrical and Electronics Engineers, 2011, 22, pp.1632--1640. 〈10.1109/TPDS.2011.32〉
Liste complète des métadonnées

https://hal.inria.fr/hal-00786549
Contributeur : Equipe Roma <>
Soumis le : vendredi 8 février 2013 - 20:10:49
Dernière modification le : vendredi 20 avril 2018 - 15:44:24

Lien texte intégral

Identifiants

Collections

Citation

Eray Ozkural, Cevdet Aykanat, Bora Uçar. Parallel Frequent Item Set Mining with Selective Item Replication. IEEE Transactions on Parallel and Distributed Systems, Institute of Electrical and Electronics Engineers, 2011, 22, pp.1632--1640. 〈10.1109/TPDS.2011.32〉. 〈hal-00786549〉

Partager

Métriques

Consultations de la notice

124