A Caltech Library Service

Proposal review rankings: the influence of reviewer discussions on proposal selection

Storrie-Lombardi, Lisa J. and Silbermann, Nancy A. and Rebull, Luisa M. and Laine, Seppo and Crane, Megan (2008) Proposal review rankings: the influence of reviewer discussions on proposal selection. In: Observatory Operations: Strategies, Processes, and Systems II. Proceedings of SPIE. No.7016. Society of Photo-Optical Instrumentation Engineers (SPIE) , Bellingham, WA, Art. No. 701622. ISBN 978-0-8194-7226-7.

[img] PDF - Published Version
See Usage Policy.


Use this Persistent URL to link to this item:


The telescope time allocation process for NASA's Great Observatories involves a substantial commitment of time and expertise by the astronomical community. The annual review meetings typically have 100 external participants. Each reviewer spends 3-6 days at the meeting in addition to one-two weeks of preparation time, reading and grading proposals. The reviewers grade the proposals based on their individual reading prior to the meeting and grade them again after discussion within the broad, subject-based review panels. We summarize here how the outcome of the review process for three Spitzer observing cycles would have changed if the selection had been done strictly based on the preliminary grades without having the panels meet and discuss the proposals. The changes in grading during the review meeting have a substantial impact on the final list of selected proposals. Approximately 30% of the selected proposals would not have been included if just the preliminary rankings had been used to make the selection.

Item Type:Book Section
Related URLs:
URLURL TypeDescription
Storrie-Lombardi, Lisa J.0000-0002-5987-5210
Rebull, Luisa M.0000-0001-6381-515X
Laine, Seppo0000-0003-1250-8314
Additional Information:© 2008 International Society for Optical Engineering.
Group:Infrared Processing and Analysis Center (IPAC)
Subject Keywords:Spitzer Space Telescope, Proposal Peer Review, Telescope Time Allocation
Series Name:Proceedings of SPIE
Issue or Number:7016
Record Number:CaltechAUTHORS:20170323-071327576
Persistent URL:
Official Citation: Lisa J. Storrie-Lombardi ; Nancy A. Silbermann ; Luisa M. Rebull ; Seppo Laine ; Megan Crane; Proposal review rankings: the influence of reviewer discussions on proposal selection. Proc. SPIE 7016, Observatory Operations: Strategies, Processes, and Systems II, 701622 (July 12, 2008); doi:10.1117/12.787964.
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:75341
Deposited By: Ruth Sustaita
Deposited On:23 Mar 2017 14:37
Last Modified:13 Nov 2019 23:39

Repository Staff Only: item control page