300 files

Accessibility and topics of citations with identifiers in Wikipedia

posted on 16.07.2018, 10:44 by Miriam Redi, Dario Taraborelli


An extended version of the dataset "Citation with Identifiers" [1] with topic and accessibility information

When possible, we associated each publication with identifier cited in Wikipedia with 1) the publication topic and 2) the information about its accessibility (e.g. if it has open access).


When possible, we have assigned a topic to each publication, by looking at the main topics of the pages citing a publication. See [2] for more details on how we infer topics.


We mark each DOI publication as Open Access or Closed Access by merging our data with Unpaywall [3] data.

Data Format

There is a file for each Wikipedia edition (e.g. English Wikipedia, Farsi Wikipedia). Each line contains the following tab-separated values:
  • page_id - the id of the Wikipedia page citing the publication, see [4]
  • page_name - the title of the Wikipedia page citing the publication
  • revision_id - the id of the revision where the citation has been added, see [4]
  • timestamp - the time when the revision has been saved
  • publication_type - the type of the publication cited, it can be: isbn,doi,pmid,pmc,arxiv
  • publication_id - the identifier of the publication, format differs according to the type
  • topic - publication topic inherited from the pages where it is cited. It can take one of the values at the top level of the Wikiprojects Hierarchy [5]
  • open_access :Open: if the canonical version is open access at the source (journal); Available: if the canonical version at the source is behind a paywall, but an open access copy is available at a different location; Closed: if the canonical version at the source is behind a paywall and not open access copy was identified at a different location
  • open_access_url - the url of the open access version of the publication, if 'open_access' is 'open' or 'available'


Visualisations summarising the data in this repository can be found in this notebook: visualizations

[1] https://figshare.com/articles/Wikipedia_Scholarly_Article_Citations/1299540

[2] https://meta.wikimedia.org/wiki/Research:Towards_Modeling_Citation_Quality

[3] http://unpaywall.org/data-format

[4] https://www.mediawiki.org/wiki/Manual:Revision_table

[5] https://en.wikipedia.org/wiki/Wikipedia:WikiProject_Council/Directory