CaltechAUTHORS
  A Caltech Library Service

Systems and methods for labeling source data using confidence labels

Welinder, Peter and Perona, Pietro (2017) Systems and methods for labeling source data using confidence labels. Patent number: US9704106B2. http://resolver.caltech.edu/CaltechAUTHORS:20180614-120834409

[img] PDF (US9704106B2) - Published Version
See Usage Policy.

1541Kb

Use this Persistent URL to link to this item: http://resolver.caltech.edu/CaltechAUTHORS:20180614-120834409

Abstract

Systems and methods for the annotation of source data using confidence labels in accordance embodiments of the invention are disclosed. In one embodiment of the invention, a method for determining confidence labels for crowdsourced annotations includes obtaining a set of source data, obtaining a set of training data representative of the set of source data, determining the ground truth for each piece of training data, obtaining a set of training data annotations including a confidence label, measuring annotator accuracy data for at least one piece of training data, and automatically generating a set of confidence labels for the set of unlabeled data based on the measured annotator accuracy data and the set of annotator labels used.


Item Type:Patent
Related Patents:US20130346356A1
Patent Classification:Current U.S. Class: 1/1. Current CPC Class: G06F 17/30598 (20130101); G06F 17/30525 (20130101); G06F 17/30303 (20130101); G06N 5/048 (20130101); G06N 99/005 (20130101); G06F 17/241 (20130101). Current International Class: G06N 5/04 (20060101); G06N 99/00 (20100101); G06F 17/24 (20060101); G06F 17/30 (20060101).
Patent Assignee:California Institute of Technology
Related URLs:
URLURL TypeDescription
https://patents.google.com/patent/US9704106B2/en?oq=US9704106B2PatentGoogle Patents
http://patft.uspto.gov/netacgi/nph-Parser?Sect2=PTO1&Sect2=HITOFF&p=1&u=/netahtml/PTO/search-bool.html&r=1&f=G&l=50&d=PALL&RefSrch=yes&Query=PN/9704106PatentU.S. Patent Office
ORCID:
AuthorORCID
Perona, Pietro0000-0002-7583-5809
Additional Information:Application filed: May 27, 2016. Patent granted: July 11, 2017.
Record Number:CaltechAUTHORS:20180614-120834409
Persistent URL:http://resolver.caltech.edu/CaltechAUTHORS:20180614-120834409
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:87107
Collection:CaltechAUTHORS
Deposited By: Caroline Murphy
Deposited On:05 Jul 2018 23:12
Last Modified:05 Jul 2018 23:12

Repository Staff Only: item control page