[Corpora-List] Using MTurk for markup tasks (was Cost of part of speech tagging)

From: Alexandre Rafalovitch (arafalov@gmail.com)
Date: Tue Dec 26 2006 - 17:40:04 MET

  • Next message: Mike Maxwell: "Re: [Corpora-List] Using MTurk for markup tasks (was Cost of part of speech tagging)"

    An interesting approach would be to use Amazon Mechanical Turk for
    this kinds of tasks. ( http://www.mturk.com/ ). At the moment, it is
    mostly used for basic cognitive tasks, but I believe it allows to
    filter the participants.

    That way one could harness the research assistants or even students
    all over the world doing the mark-up in their lesure time.

    At the moment, I don't think an interface exists that will allow to
    use MTurk for this goal, but that could really become a great project
    for someone and possibly even a stream of papers.

    Has anybody else given a thought to this?

    Regards,
       Alex.

    On 12/23/06, Marc Carmen <marc.carmen@gmail.com> wrote:
    > Hello all! Does anyone have any thoughts on what the cost of annotating a
    > corpus with part of speech tags is? For example, would you pay someone per
    > word or per sentence and how much? Any other thoughts or information on
    > corpus preparation and financial cost would be very helpful. Thanks for
    > advance for any thoughts.



    This archive was generated by hypermail 2b29 : Tue Dec 26 2006 - 17:37:47 MET