The contractor will conduct a statistical analysis and summarize quantitative data to determine whether using Imagine Math is correlated to improved student achievement on the Idaho Standards for Achievement Test. This program evaluation will use Spring 2024 and 2025 ISAT data to correlate ISAT math achievement with Imagine Math lessons passes and other use data and compare users of the program to non-users. The statistical analysis of ISAT data will include a specific look at usage data and related achievement of subgroups such as but not limited to students with disabilities, English Language Learners, students living in poverty, and ethnic minorities. The contractor will collaborate with the Idaho Department of Education Mathematics Coordinators and other Idaho Department of Education and/or Office of the State Board of Education staff on the statistical analysis design to ensure student data privacy policies for the state of Idaho are followed. This contract request is related to two five year contracts with Imagine Math, contract 23-3700 and contract 23-3701. Additionally, the contractor will support the Idaho Department of Education Mathematics Coordinators in the preparation of a teacher survey for users of the product and analyze the results of the survey after administration to determine what teacher practices in the use of the product correlate to student achievement growth and performance. The contractor will conduct two virtual focus groups with teachers using the product to further understand effective teaching practices related to the use of the online, adaptive system in mathematics. The contractor will plan and facilitate planning meetings with Idaho Department of Education and/or Office of the State Board of Education staff. They will summarize and present findings to Idaho Department of Education Mathematics Coordinators and other Idaho Department of Education and/or Office of the State Board of Education staff. The final, submitted product of this evaluation will be a formal written report and a slide deck for use by the Idaho Department of Education for communication about the evaluation.
