I'm not sure people realize how important human judgments are. For any intelligent system, it's not just the data, it's the labeled data, and all the work necessary to make sure the ground truth is actually good ground truth. Google supposedly employs "over 10,000 raters" in a custom system for this purpose.

https://arstechnica.com/features/2017/04/the-secret-lives-of-google-raters/
Shared publiclyView activity