Project Evaluation Criteria
The review criteria for S2C2 proposals are primarily based on the mission of the National Institutes of Health's Transformative High Resolution Cryo-Electron Microscopy Program as the program supports the center financially. More specifically, our external, peer review, Project Review Committee is considering the following criteria for the proposal review:
Scientific Merit
- Intellectual impact of the work on the field.
- Need for cryoEM to achieve project aims.
- Value of using single particle cryoEM approaching atomic resolution towards project aims
Project Readiness
- Based on preliminary data for the proposed specimen(s)
- Prior image data (preliminary cryoEM screening and/or negative-stain electron micrographs), 2D class averages, and/or a lower resolution 3D reconstruction are needed to substantiate the feasibility of the project.
- SDS-PAGE gels and/or SEC traces are needed to assess specimen purity for single particle cryoEM.
- The cryoEM research experience of the investigators.
- The investigators' access to SPA-capable cryoEM facilities at either their home instiution or elsewhere.
Geographic and Institutional Association
- This information is utilized to prevent untoward monopolization of center resources by partnering institutions or geographic regions.
Each of the three kinds of applications (i.e., Data Collection Service, Exploratory Freezing & Screening, or Training) are evaluated separately by the Project Review Committee. Scientific merit is considered equally for all three kinds of applications; however, the bar for project readiness is lower for exploratory freezing & screening projects and the lowest for training projects. The committee may reassign projects from data collection service to exploratory freezing & screening or training project types based on project readiness as appropriate.
To ensure consistency in the evaluation process, the committee uses the following rating scale from 1 (best rating) to 5 (worst rating):
Excellent (1.0 - 1.9)
- A well-chosen problem or important research that has a good chance of producing a major contribution to fundamental knowledge or an important technological development through high resolution single particle cryo-EM studies.
- Proposed specimens are ready for high-resolution, single particle cryoEM studies.
- Specimens produced/procured at sufficient quantity and purity.
- Preparatory conditions optimized for specimen vitrification.
- Given highest priority for microscope time.
- A rating of 1.0-1.4 is given to the most compelling proposals with the greatest likelihood of a high-profile publication.
Very Good (2.0 - 2.9)
- A worthwhile problem or valuable research that may lead to advances in fundamental knowledge or technology.
- Proposed specimens are ready for high resolution, single particle cryoEM studies.
- Specimens produced/procured at sufficient quantity and purity
- Preparatory conditions optimized for specimen vitrification.
- Given second priority for microscope time, as resources permit.
Good (3.0 - 3.9)
- A reasonable problem for single particle cryoEM, but less than cutting edge, forefront research.
- Proposed specimens are not quite ready for high resolution single particle cryoEM studies.
- Specimens produced/procured at a questionable quantity and/or purity.
- Preparatory conditions not optimized for specimen vitrification.
- Given microscope time only after all projects rated excellent and very good have received time.
Fair (4.0 - 4.9)
- Significant deficiencies appear in the proposed project regarding scientific merit and/or project readiness.
- Unlikely to be given microscope time.
Poor (5.0)
- The proposed project is poorly designed and/or communicated.
- Major scientific and/or technical issues remain unaddressed.
- Not to be given microscope time.