HTRC Extracted Features [v.0.2] `langid`

2016-05-16T20:46:46Z (GMT) by Ryan Baumann
<div>This archive contains the results of computing `langid` for the OCR tokens of each page in every volume of the HathiTrust HTRC Extracted Features [v.0.2] dataset. Each file is a CSV file of ISO639-1 language code and probability pairs for each page, where the filename is `[HTRC-volume-identifier].basic.json.csv`. Version 1.1.5 of `langid` was used for processing.</div><div><br></div><b>Warning:</b> this archive will decompress to a ~25GB directory containing 4,805,434 files.