Specifications include, but are not limited to: 1. Develop an evaluation plan that will be an expanded version of the initial plan described in the proposal, is consistent with project goals, and complies with the NSF review criteria for program evaluation. 2. Review the project objectives, anticipated outcomes, and evaluation design and work with the project team to further refine the evaluation questions and the logic model. 3. Help establish valid baseline data, an internal evaluation reporting system, and a mechanism for using ongoing evaluation results to improve the program. 4. Throughout the project duration, provide unlimited communication through telephone, email, or online meetings concerning the evaluation of the grant project. Meet with the PI, Co-PI, and the Cohort Evaluation Committee at least monthly. 5. Provide the project team with feedback and any findings resulting from the review of data and intermittent reports, including addressing barriers to progress toward objectives. 6. Prepare the Quarterly Evaluation Report (QER) which will include a dashboard-like overview of the key metrics and a detailed description of evaluation activities conducted during the quarter. 7. Review the QER with the cohort evaluation committee to identify opportunities for improvement and any areas that may require immediate action or further investigation. 8. Prepare the Annual Evaluation Report (AER) which will include a dashboard-like overview of key metrics and a detailed description of evaluation activities conducted throughout the grant year. 9. Review the AER with the Cohort Evaluation Committee and identify major strategies for modifications and improvements for the upcoming grant year.
