AES Certification Testing for 2016 National Election
Republic of the Philippines – COMELEC, September 2015 – February 2016
For the 2016 National and Local Elections, The Republic of Philippines Commission on Elections (COMELEC) contracted SLI Compliance as their International Certification Entity (ICE) to provide certification testing that ensures the election system operates properly, securely, and accurately during the May 2016 National Election. Testing was provided at SLI’s compliance test facility in Wheat Ridge, CO and on-site in Manila.
The SLI ICE Team verified that all components of the system were functional according to the specifications determined by COMELEC; provided a review of all documentation, software, firmware, and hardware components; and developed the certification test report.
AES Certification Testing for the 2013 National Election
Republic of the Philippines – COMELEC, September 2012 – February 2013
SLI Compliance tested the Automated Election System (AES) provided by Smartmatic, Inc. for compliance with Philippine federal election law for use in the 2013 National elections. Testing included all functionality, performance, code review, security, and hardware aspects of the system, which comprised over 80,000 precinct scan units, multiple consolidators, and reporting protocols. Testing was provided at SLI’s compliance test facility in Denver, CO and on-site in Manila.
Autonomous Region of Muslim Mindanao (ARMM) 2012 Election
Republic of the Philippines – COMELEC, January 2011– August 2011
SLI Compliance performed a follow-on certification process on a custom voting system for COMELEC. The SLI Compliance VSTL team conducted manual and automated voting system source code reviews to verify that the software complied with stated standards. This included systems from both Smartmatic and Dominion Voting Systems. The reviewed software was intended for use in the Autonomous Region of Muslim Mindanao (ARMM) until the election was postponed into 2012.
AES Certification Testing for the 2010 National Election
Republic of the Philippines – COMELEC, November 2009 – March 2010
SLI Compliance completed testing for the Automated Election System (AES) that was used in the Philippine National election in 2010. This project was a first-of-a-kind international certification test program conducted by a US company. Eighty-thousand scanning machines were deployed in the over 7,000 islands using a complex transmission protocol that had never been used before. SLI’s project delivered the comprehensive results needed to support a timely go/no go decision for electronic elections. In order to accomplish this, SLI tested the performance, accuracy, and security of the system. SLI executed a full audit, code review, and test of all system characteristics by applying innovative test methods that covered extreme technical requirements and logistical challenges. SLI engineers developed a load generation tool that was specifically tailored to combine actual test traffic on the system along with simulated vote data. The results of the simulated load test indicated that the system would be able to handle the projected transmittal rates, and the results on Election Day confirmed our findings.
What we did
- Source Code Review to validate that code is written to requirements
- Documentation Review to evaluate conformance to the requirements
- Test Plan to define all aspects of testing
- Trusted Build and Installation of Build to provide assurance that the software is able to be installed
- Computer Images and Hashes to ensure coded has been tracked from review to the installed software
- Functional Testing with a focus on security and accuracy to verify the production environment meets requirements
- Environmental and Electrical Hardware Testing to verify the components meet requirements
- Test Report to outline all testing conducted and to provide a certification determination recommendation
- Comments and Recommendations on implementation plans including field tests and mock election plans