figshare
Browse
1/1
3 files

Reply & Supply: Experiment 2 (Synonym Proposal Task) Crowdsourcing Data

dataset
posted on 2017-07-07, 17:20 authored by James BagrowJames Bagrow
These data support the synonymy proposal task (SPT) experiment described in the paper "Reply & Supply: Efficient crowdsourcing when workers do more than answer questions", https://arxiv.org/abs/1611.00954.


The data consist of two CSV files, one describing the questions built by the crowd as they work, the other recording the responses of workers when presented with questions. A "question id" (`qid`) field links these data. The IDs of Mechanical Turk workers were deidentified. The task interface is described in Fig. 2 of the paper.

Three question sampling algorithms were tested in the experiment. These are recorded in the `algorithm`. Note that workers may participate in multiple algorithms, and that `qid` is only unique for a given algorithm (`qid` 1 under the `random` algorithm and `qid` 1 under the `binomial` algorithm are not the same question).

Funding

NSF IIS-1447634

History

Usage metrics

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC