Since January I have created a tool which allows for the creation of a database of Wikipedia edits, Namespace Database. As I now have this database I have been able to create the following plots. This is a work in progress, and will evolve over time :)
💡 Tip: Click and hold the images to zoom
A namespace on Wikipedia is the section that the page is in. Most people only know about the article or main namespace, where the articles are. There are other namespaces such as User for profiles, Wikipedia for policy discussion etc.
The main focus of the last third of the graphs is talk space. This is section for discussion of page, and every namespace has a corresponding talk space. In my graphs I am only looking at the talk space of articles. For example, people arguing whether to use BC or AD on the Jesus article
Simply these are users you could think of as admins. They have privilege to edit protected pages, confirm edits aren’t spam etc. You can view all of the groups in figures 18.1 and 18.2.
Bots on Wikipedia don’t directly add content, but they help by doing the tedious tasks like fixing broken links and adding templates, which help humans fix articles.
The namespaces with the most pages are Article and User talk. User talk has more pages than User as users themselves usually create their own pages, whereas anyone can write on your talk page.
With a log view on the same plot, we see that there is a large variety in the number of pages in each namespace. Two namespaces have no pages and are not listed here which are the virtual namespaces -1 Special and -2 Media.
Most of the pages in the top four namespaces only have a single edit. Main talk space however more often has a couple edits than a single one, potentially due to a talk edit provoking conversation. Unsurprisingly, main space has the highest ratio of pages with over 100 edits. It’s worth noting that the Y-axes are consistent across all plots.
Unsurprisingly, the namespace with the most editors is main article space, with all other namespaces having less engagement. Bots are active in a lot of namespaces, and ~40% don’t edit main space.
94.3% of users do not edit in talk space. In other namespaces, across all users, most only make a single edit.
Showing the intersection of the above graphs, 3.6% of users edit both main and talk space.
Ser Amantio di Nicolao, Koavf, and Rich Farmbrough are the only editors to appear in both graphs
126.96.36.199, 188.8.131.524 and 184.108.40.206 are the only editors to appear in both graphs
AnomieBTO, Yobot and InternetArchiveBot are the only editors to appear in both graphs.
We have mainspace edits on the left and talkpage edits on the right, and each column is a different user group. Each group seems to have different peak in main space edits, with blocked being a subset of the user distribution. Bots are the most different group of editors which follows intuition.
This is a break down of figure 4 for the different user groups. Blocked users proportionally edit both main and talk compared to the wider population of users in general.
Users with special privileges have both the longest maximum time between edits and edit more frequently than users in general. Blocked users have shorter account durations which follows intution.
Unlike the other plots, the data represented in this chart is directly from the dumps and no processing is needed. These are all of the user groups in wikipedia and all of them are positive and denote a privilege that the user can subsequently do. Extended confirmed is the largest group as all non-blocked accounts that reach 500 edits and are 30 days old become extended confirmed.
A log version of the previous plot. Details of the groups can be found User access levels page at Wikipedia.
Only 93,851 IPs have been indefinitely blocked on Wikipedia, far less than the 41 million IPs that have ever made edits.
The 14,074 special users (excluding extended confirmed, confirmed and bots) make 42% of talkpage edits. IP users have the greatest reduction making up only 9% of talkpage edits.
This shows the proportion of users that have a specific boolean feature. Autoconfirmed is the largest as all users with over 5 edits are autoconfirmed, showing the overwhelming majority of users make less than that many edits.
Experimentally we applied TextBlob to get the sentiment of talkpage edits. On average all edits add or remove positive content. As the average removed content is more neutral, we can imagine that more negative content is removed.
To investigate whether there was a bias on whether positive or negative content was added, I seperated edits from different groups into subsets where the content added/deleted was positive/negative. Additionally, only edits where both added and deleted had sentiment were considered. On average, when blocked IP users add negative content they also delete positive content.
It’s clearer here that blocked IP’s are the only editors “cross the line”, signalling that they deleted the opposite sentiment on average to the other groups.
This plot is the total sentiment added and deleted from the page — i.e. for “Added Positive” it is the added sentiment minus the deleted sentiment — this allows us to see which groups have the largest affect on talkpage sentiment with their edits.
IPs use similar amounts of profanity whether they are blocked or not.
This shows the average value for all edit fields with error bars.
The average inserted internal links must be at least 1 as every comment is automatically inserted with a link to their user page if they don’t sign their comment. I expected users with special privileges to insert far more links.
It’s clear that edits that we think of as spammy — high vulgarity, high reversions, blanking (removing pages) - are performed by blocked IPs and not blocked users. Blocked IPs also delete the least but add the most, think copy and pasting lots of random text. Special users suprisingly don’t appear on any extremes other than they are reverted the least. The vertical bars are the average of all users.
A dendrogram created from the features from the previous plot
Showing the range of all the integer values. Sentiment is constrained into a very tight range, suggesting people aren’t usually emotive in talkpage edits.
This shows the proportion of edits which have a specific boolean feature.
The large spike is from the 14th-17th of September 2012 and was the result of Yobot making 329,486 edits in 4 days, phew!
Figure 25 but per year and per month, the large spike in 2012 even seems to appear in the yearly plot. It does seem that talkpage engagement has fallen since 2007 at 6,072,548 edits.
Much less noisy when bots are excluded.
A plot similar, but showing how editing has changed in the first 9 years compared to the second 9 years of the dataset. There’s less vulgarity, less reversion, less blanking, longer comments so at this level Wikipedia talkpage edits seem healthier on average.
All of the features in the previous plots over time.
Same as the previous plot but averaged per year.