BriefGPT.xyz
Nov, 2014
适应性探索：收集高质量标签所需的工人数量
Using Worker Quality Scores to Improve Stopping Rules
HTML
PDF
Ittai Abraham, Omar Alonso, Vasilis Kandylas, Rajesh Patel, Steven Shelford...
TL;DR
本文研究了如何利用质量评分来设计更好的停止规则，同时提出了自适应探索作为一种可扩展且自动创建基准的有前途的方法。通过一个实验模拟，证明了我们的算法比传统方法表现更优。
Abstract
We consider the
crowdsourcing
task of learning the answer to simple multiple-choice microtasks. In order to provide statistically significant results, one often needs to ask multiple workers to answer the same microtask. A
→