CaltechAUTHORS
  A Caltech Library Service

Clinical Online Recommendation with Subgroup Rank Feedback

Sui, Yanan and Burdick, Joel (2014) Clinical Online Recommendation with Subgroup Rank Feedback. In: RecSys '14 Proceedings of the 8th ACM Conference on Recommender Systems. Association for Computing Machinery , New York, NY, pp. 289-292. ISBN 9781450326681 . https://resolver.caltech.edu/CaltechAUTHORS:20141015-100508890

[img]
Preview
PDF - Published Version
See Usage Policy.

874Kb

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20141015-100508890

Abstract

Many real applications in experimental design need to make decisions online. Each decision leads to a stochastic reward with initially unknown distribution. New decisions are made based on the observations of previous rewards. To maximize the total reward, one needs to solve the tradeoff between exploring different strategies and exploiting currently optimal strategies. This kind of tradeoff problems can be formalized as Multi-armed bandit problem. We recommend strategies in series and generate new recommendations based on noisy rewards of previous strategies. When the reward for a strategy is difficult to quantify, classical bandit algorithms are no longer optimal. This paper, studies the Multi-armed bandit problem with feedback given as a stochastic rank list instead of quantified reward values. We propose an algorithm for this new problem and show its optimality. A real application of this algorithm on clinical treatment is helping paralyzed patient to regain the ability to stand on their own feet.


Item Type:Book Section
Related URLs:
URLURL TypeDescription
http://dx.doi.org/10.1145/2645710.2645773DOIArticle
http://dl.acm.org/citation.cfm?doid=2645710.2645773PublisherArticle
Additional Information:Copyright is held by the owner/author(s). Publication rights licensed to ACM. This work was supported by the the Helmsley Foundation, the Christopher and Dana Reeve Foundation, and the National Institutes of Health (NIH).
Funders:
Funding AgencyGrant Number
Helmsley FoundationUNSPECIFIED
Christopher and Dana Reeve FoundationUNSPECIFIED
NIHUNSPECIFIED
Subject Keywords:Clinical Recommendation, Exploration-Exploitation Trade-off, Bandit Problem, Rank-Comparison
Record Number:CaltechAUTHORS:20141015-100508890
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20141015-100508890
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:50398
Collection:CaltechAUTHORS
Deposited By: Tony Diaz
Deposited On:15 Oct 2014 17:49
Last Modified:03 Oct 2019 07:23

Repository Staff Only: item control page