GHVFDT

2015-09-07T12:43:03Z (GMT) by Robert Lyon
<p>Gaussian Hellinger Very Fast Decision Tree (GH-VFDT)</p> <p>An imbalanced data stream classifier, which uses the Hoeffding bound and Hellinger distance, to improve minority class recall.</p> <p> </p> <p>Overview</p> <p>The GH-VFDT utilises a decision tree split criterion, designed to improve minority class recall rates on imbalanced data streams, i.e. those streams where the class distribution is worse than 1:100. This implementation is built upon the Hoeffding Tree provided in MOA, thus a great deal of credit goes to the MOA team for their initial implementation and library. We greatly acknowledge their efforts.</p> <p>For more details of the algorithm (bibtex reference below) see,</p> <p>R. J. Lyon, J. M. Brooke, J. D. Knowles, B. W. Stappers. Hellinger Distance Trees for Imbalanced Streams In 22nd International Conference on Pattern Recognition, pages 1969-1974, Stockholm, Sweden, 2014. IEEE.</p> <p>Algorithms</p> <p>There are two version of the algorithm provided. The first version is designed to work with the MOA stream testing framework. It can be found in the MOA sub-directory of the distribution. The second version is a complete Java version that requires no external libraries, designed to operate outside of MOA. Use whichever version suits your needs.</p> <p>Use</p> <p>MOA VERSION - The algorithm is designed to work directly with the MOA stream test framework. To use it with MOA, simply download the MOA files, and navigate to the MOA download directory. Make sure this directory contains the following files:</p> <p>i) moa.jar ii) sizeofag.jar iii) weka.jar - optional, include if you intend to use WEKA classifiers.</p> <p>Copy the GHVFDT.jar file to the MOA download directory, then execute the following command at the terminal/command line:</p> <p>java -cp GHVFDT.jar:moa.jar -javaagent:sizeofag.jar moa.gui.GUI</p> <p>or if also using WEKA classifiers,</p> <p>java -cp GHVFDT.jar:moa.jar:weka.jar -javaagent:sizeofag.jar moa.gui.GUI</p> <p>When MOA starts, the GH-VFDT will be included in the list of classifiers available for testing.</p> <p>Alternatively this algorithm can be used outside of MOA. Please see our Stuffed framework for a simple example of how this is possible. Stuffed is a wrapper for WEKA and MOA classifiers that enables evaluation on large, unlabelled data sets. Please see:</p> <p>https://github.com/scienceguyrob/Stuffed</p> <p>Java VERSION -</p> <p>Find the ClassifierTest.java file in the Java directory. This is a complete example showing how to run and test the algorithm.</p> <p>Citing our work</p> <p>Please use the following citation if you make use of this algorithm and cite the algorithm too using the figure DOI:</p> <p>@inproceedings{Lyon:2014:jk, author = {{Lyon}, R.~J. and {Knowles}, J.~D. and {Brooke}, J.~M. and {Stappers}, B.~W.}, title = {{Hellinger Distance Trees for Imbalanced Streams}}, booktitle = {22nd IEEE International Conference on Pattern Recognition}, series = {ICPR '14}, year = {2014}, month = {August}, pages = {1969-1974}, location = {Stockholm, Sweden}, publisher = {IEEE} }</p> <p>Acknowledgements</p> <p>This work was supported by grant EP/I028099/1 for the University of Manchester Centre for Doctoral Training in Computer Science, from the UK Engineering and Physical Sciences Research Council (EPSRC).</p>