Turkalytics: Analytics for Human Computation

Presented at: 20th International World Wide Web Conference (WWW2011)

by Paul Heymann, Hector GarciĆ -Molina

Webpage: http://wwwconference.org/www2011/proceeding/proceedings/p477.pdf

We present "Turkalytics," a novel analytics tool for human computation systems. Turkalytics processes and reports logging events from workers in real-time and has been shown to scale to over one hundred thousand logging events per day. We present a state model for worker interaction that covers the Mechanical Turk (the SCRAP model) and a data model that demonstrates the diversity of data collected by Turkalytics. We show that Turkalytics is effective at data collection, in spite of it being unobtrusive. Lastly, we describe worker locations, browser environments, activity information, and other examples of data collected by our tool.

Turkalytics: Analytics for Human Computation was presented at this event.

Keywords: Performance and Systems, World Wide Web


Resource URI on the dog food server: http://data.semanticweb.org/conference/www/2011/paper/turkalytics-analytics-for-human-computation


Explore this resource elsewhere: