An external evaluation of the program’s effectiveness. General objectives of the evaluation: Determine the fidelity of implementation, at the grade, school and LEA level, of the early literacy software by the LEAs as determined by the recommendations of each specific vendor. Determine student progress and achievement on reading skills based on an external assessment (Acadience). Determine if student learning and achievement is affected by computer aided instruction (CAI). Contact up to 15 vendors (as specified by USBE) to: Give a mid-year review to ascertain the accuracy percentage of the number of SSID Matches with students Work with those vendors to get to an at least 95% accuracy rate Incorporate up to 15 vendors in the final evaluation report The external evaluator is responsible for: designing and implementing the project’s evaluation methodology; revising statutory goals, objectives, and performance measures in collaboration with responsible USBE personnel; collecting and validating data; assessing each vendor’s data mid-year for compliance and provide explicit feedback to USBE and vendor; revising performance measures after data is collected; providing annual evaluation reports no later than October 1st for the previous school year or at a date arranged with USBE; providing a final summative report at the end of the project; collaborating with early literacy software vendors; collecting and analyzing high-quality, reliable data; collecting and maintaining data using secure methods between USBE, vendors, and other collaborators; participating in regular calls and/or meetings with USBE personnel; creating three presentations regarding vendor data collection, annual report outcomes, and legislative overview of program each year; and, providing USBE copies of all data and analysis upon contract close.
