Profile cover photo
Profile photo
Panos Ipeirotis
2,343 followers -
Panos Ipeirotis is a Professor of Data Science and Information Systems at Stern School of Business, New York University
Panos Ipeirotis is a Professor of Data Science and Information Systems at Stern School of Business, New York University

2,343 followers
About
Posts

Post has attachment
An estimation of the size of the Mechanical Turk workforce.

TL;DR: There are about 100K-200K unique workers on Amazon. These workers though exhibit widely different patterns of activity, with most workers being active only occasionally, and few workers being very active. On average, there are 2K-5K workers active on Amazon at any given time. Combining these results from Hara et al, we see that MTurk has a yearly transaction volume of a few hundreds of millions of dollars.
Add a comment...

Post has attachment
How many Mechanical Turk workers are there?
TL;DR: There are about 100K-200K unique workers on Amazon. These workers though exhibit widely different patterns of activity, with most workers being active only occasionally, and few workers being very active. On average, there are 2K-5K workers active on...
Add a comment...

Post has attachment

Post has attachment
Why was my Amazon Mechanical Turk registration denied?
( This is my answer to a question posted on Quora ) Mechanical Turk is a platform for work. Workers get paid, which makes now Amazon a payment processor. Payment processors are moving money on behalf of other people, and therefore are under heavy scrutiny f...
Add a comment...

Post has attachment
AlphaGo lost today after the human player made an unexpected move, throwing off AlphaGo expectations. This reminded me of our  "Beat the Machine" system, where we incentivized humans to find examples that the machine misses, and makes incorrect decisions with confidence. Typically these examples were cases that were  unlike any examples in the (existing) training data. These are the "unknown unknowns" for the machine learning systems, and humans can help discover such cases quickly.
Add a comment...

Post has attachment
Doing a cohort analysis of Amazon Mechanical Turk requesters.
Add a comment...

Post has attachment
A Cohort Analysis of Mechanical Turk Requesters
In my last post, I examined the number of "active requesters" on Mechanical Turk, and concluded that there is a significant decline in the numbers over the last year. The definition of "active requester" was: " A requester is active at time X if he has a HI...
Add a comment...

Post has attachment
The number of active requesters on Amazon Mechanical Turk has declined by 50% over the last year.
The Decline of Amazon Mechanical Turk
The Decline of Amazon Mechanical Turk
behind-the-enemy-lines.com
Add a comment...

Post has attachment
The Decline of Amazon Mechanical Turk
It seems that after years of neglect, Mechanical Turk starts losing its appeal. In our latest measurement, we see Mechanical Turk losing 50% of its requesters in a YoY measurement. A few days ago,  Kristy Milland (aka SpamGirl) asked me if there is a way to...
The Decline of Amazon Mechanical Turk
The Decline of Amazon Mechanical Turk
behind-the-enemy-lines.com
Add a comment...

Post has attachment
Now all the demographics survey data from Mechanical Turk tracker is available through an API, so that people can run their own analyses.
Add a comment...
Wait while more posts are being loaded