CaltechAUTHORS
  A Caltech Library Service

Fundamental Limits of Budget-Fidelity Trade-off in Label Crowdsourcing

Lahouti, Farshad and Hassibi, Babak (2016) Fundamental Limits of Budget-Fidelity Trade-off in Label Crowdsourcing. In: Proceedings of the 30th International Conference on Neural Information Processing Systems. Advances in Neural Information Processing Systems. No.29. Neural Information Processing Systems Foundation, Inc. , pp. 5065-5073. ISBN 978-1-5108-3881-9. https://resolver.caltech.edu/CaltechAUTHORS:20210105-133359837

[img]
Preview
PDF - Published Version
See Usage Policy.

178kB
[img] PDF - Submitted Version
See Usage Policy.

418kB
[img] Archive (ZIP) - Supplemental Material
See Usage Policy.

428kB

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20210105-133359837

Abstract

Digital crowdsourcing (CS) is a modern approach to perform certain large projects using small contributions of a large crowd. In CS, a taskmaster typically breaks down the project into small batches of tasks and assigns them to so-called workers with imperfect skill levels. The crowdsourcer then collects and analyzes the results for inference and serving the purpose of the project. In this work, the CS problem, as a human-in-the-loop computation problem, is modeled and analyzed in an information theoretic rate-distortion framework. The purpose is to identify the ultimate fidelity that one can achieve by any form of query from the crowd and any decoding (inference) algorithm with a given budget. The results are established by a joint source channel (de)coding scheme, which represent the query scheme and inference, over parallel noisy channels, which model workers with imperfect skill levels. We also present and analyze a query scheme dubbed k-ary incidence coding and study optimized query pricing in this setting.


Item Type:Book Section
Related URLs:
URLURL TypeDescription
https://papers.nips.cc/paper/2016/hash/339a18def9898dd60a634b2ad8fbbd58-Abstract.htmlPublisherArticle
https://arxiv.org/abs/1608.07328arXivDiscussion Paper
ORCID:
AuthorORCID
Lahouti, Farshad0000-0002-8729-873X
Additional Information:© 2005 Neural Information Processing Systems Foundation, Inc.
Series Name:Advances in Neural Information Processing Systems
Issue or Number:29
Record Number:CaltechAUTHORS:20210105-133359837
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20210105-133359837
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:107319
Collection:CaltechAUTHORS
Deposited By: George Porter
Deposited On:05 Jan 2021 22:54
Last Modified:06 Jan 2021 18:21

Repository Staff Only: item control page