I'm not sure people realize how important human judgments are. For any intelligent system, it's not just the data, it's the labeled data, and all the work necessary to make sure the ground truth is actually good ground truth. Google supposedly employs "over 10,000 raters" in a custom system for this purpose.
The secret lives of Google raters
5 plus ones
Shared publicly•View activity
Add a comment...