Snooping Wikipedia Vandals with MapReduce - IMT - Institut Mines-Télécom
Communication Dans Un Congrès Année : 2015

Snooping Wikipedia Vandals with MapReduce

Résumé

In this paper, we present and validate an algorithmable to accurately identify anomalous behaviors on online andcollaborative social networks, based on their interaction withother fellows. We focus on Wikipedia, where accurate groundtruth for the classification of vandals can be reliably gatheredby manual inspection of the page edit history. We develop adistributed crawler and classifier tasks, both implemented inMapReduce, with whom we are able to explore a very largedataset, consisting of over 5 millions articles collaborativelyedited by 14 millions authors, resulting in over 8 billion pairwiseinteractions. We represent Wikipedia as a signed network, wherepositive arcs imply constructive interaction between editors. Wethen isolate a set of high reputation editors (i.e., nodes havingmany positive incoming links) and classify the remaining onesbased on their interactions with high reputation editors. Wedemonstrate our approach not only to be practically relevant(due to the size of our dataset), but also feasible (as it requiresfew MapReduce iteration) and accurate (over 95% true positiverate). At the same time, we are able to classify only about halfof the dataset editors (recall of 50%) for which we outline somesolution under study.

Fichier non déposé

Dates et versions

hal-01279007 , version 1 (25-02-2016)

Identifiants

  • HAL Id : hal-01279007 , version 1

Citer

Michele Spina, D. Rossi, Mauro Sozio, Silviu Maniu, Bogdan Cautis. Snooping Wikipedia Vandals with MapReduce. IEEE ICC, Feb 2015, London, United Kingdom. ⟨hal-01279007⟩
161 Consultations
0 Téléchargements

Partager

More