This file contains 5,000 manually double-annotated tweets on whether they represent a relevant or non-relevant mention to mephedrone, a novel psychoactive substance.