1. Functional Testing The functional test evaluates the extent to which the system is accurate, efficient, reliable, accessible and secure, pursuant to the requirements of California state law, and California Voting System Standards (CVSS). For the functional testing, the Contractor shall assist the Secretary of State as needed with all pre-voting, voting, and post voting requirements of CVSS Section 2, gathering of pertinent data, preparation of the written functional test plan, conducting functional tests, and preparing a written functional test report. The Contractor shall assist with the installation of the system environment and the gathering of pertinent data during the installation as follows: • Configure a Trusted Build or “witnessed compile in an audited compilation environment” • Contractor will assist with the installation: o Format the hard disks on the server(s) and workstation(s); o Install the operating system; o Benchmark the system, through hash values and images, in various stages throughout the process; o Install the commercial off-the-shelf software; o Establish any network connections and configurations necessary; o Set up administrator and user accounts, apply security templates, system hardening or disabling of services; o Install voting system software and firmware on each voting device. • Configure seven test election definitions, one for each of the following types of election: o California Top-Two Primary Election; o California Gubernatorial General Election; o California Recall Election; o California Presidential Primary; o California Presidential General Election; o Vote Center Election; and o Miscellaneous Election to cover any further requirements of CVSS section 2. • Test the import of election results with Election Night Reporting templates as provided by the Secretary of State. Including the Statement of Vote (SOV) and the Supplemental Statement of Vote (SSOV) files. • Provide access to MD5 Message-Digest Algorithm software to produce a hash value, whenever requested by the Secretary of State, to be used to check data integrity of the system that is being tested. • Provide software to image the system at various stages of building the system, whenever requested by the Secretary of State. Such images will be maintained and used by the Secretary of State in compliance with the Non-Disclosure Agreement (NDA). Contractor will perform the following tasks: • Assist with, or perform the Physical Configuration Audit (CVSS 2.6.7.3). • Assist with, or perform the Functional Configuration Audit (CVSS 2.6.7.4). • Prepare the functional test plan. • Conduct the functional tests. • Prepare written functional test reports.
