False positives (non-redactions) extracted from ASIO surveillance records in National Archives of Australia Series A6119
datasetposted on 27.10.2016 by Tim Sherratt
Datasets usually provide raw data for analysis. This raw data often comes in spreadsheet form, but can be any collection of data, on which analysis can be performed.
This is a collection of false positives detected by a script to extract redactions (blacked out words and phrases) from surveillance files created by the Australian Security Intelligence Organisation (ASIO) and held in Series A6119 at the National Archives of Australia.
The digitised records were harvested from the NAA's online database as a collection of individual page images. These images were then processed to find and extract redactions.
After running the script, I manually removed non-redactions which are included in this fileset for comparison. There was about a 20% error rate. See the linked fileset for more information.
The filenames of the images provide important contextual information. For example:
1009279-p10-1-74-54.jpg -- has the following attributes
File barcode: 1009279
Redaction number: 1
You can search the NAA database to find the original file using the barcode, or construct a link like:
to view the page from which the redaction was extracted in my own experimental interface.