EXAMINATIONS
Better Quality, Better Security, Better Exam Candidate Experience
Our move to computer-based examinations means more testing dates and faster results. And it’s making it easier for us to catch cheaters, too
convenient test locations across Canada and internationally, with almost four times the number of testing dates. And similar to the FE, candidates now have access to online practice tests to help them get ready for the exam. But computer testing isn’t just more efficient — it’s also much more secure. It has allowed us to make better use of several advanced security tools that are part of our regular post-exam results process- ing. These tools help us identify and investigate candidates who may be engaging in unethical behavior and compromising exam security. One such tool is collusion detection analysis. This highly effective approach uses algorithms to statistically identify pairs of candidates who have copied each other’s answers during an exam. By inspecting certain details, like candidates’ responses to questions and how long their responses are, we can detect cheating. Question content theft is another area of security. APEGA regularly conducts screening to determine if breaches have occurred. When candidates talk about, memorize, or in other ways share exam questions after an exam, a breach has occurred. Cheating does happen — and there are serious consequences. APEGA investigates candidates flagged as engaging in collusion or sharing question content. If found in violation, their exam results can be withheld or their application to APEGA cancelled.
The successful delivery of more than 9,000 exams a year to applicants and Professional Members is no small task for APEGA. Exams we oversee include the National Professional Practice Examination (NPPE), a variety of technical exams, and exams offered through two U.S. organizations, the National Council of Examiners for Engineering and Surveying (NCEES) and the National Association of State Boards of Geology (ASBOG). Applicants and Members take these exams for a variety of reasons. Some write them to start their careers after graduation or to continue their careers in Alberta or the U.S. Others are assessed exams by the Board of Examiners as part of their APEGA membership application. And all APEGA applicants must take the NPPE as a requirement of licensure.
COMPUTER-BASED TESTING: FASTER RESULTS, ENHANCED SECURITY
Ensuring the quality of exams and safeguarding their security ensure that candidates are assessed in a fair, valid, and reliable manner. One way we meet those requirements is computer-based testing. In January 2015, for example, APEGA worked with NCEES to switch the Fundamentals of Engineering (FE) exam from paper to computer-based testing. The FE exam confirms the technical knowledge of engineering graduates. This change brought many benefits to candidates taking the FE, including more testing dates and online practice tests to help them prepare. Also in 2015, we successfully transitioned the NPPE from paper to computer testing. This exam assesses applicants’ knowledge of professionalism, professional practice, law, regulation, and ethics. Moving the NPPE online has significantly improved turnaround time for exam results. Candidates now get their marks about two weeks after completing the exam, which is down from the previous six to eight weeks. Candidates also have dozens of
FAIR, VALID, RELIABLE
Computer-based testing is making it even easier for APEGA to administer exams that are fair, with results that are valid and reliable. Indeed, the quality of exams taken by applicants and Members has never been better. We’ll continue to make improvements to our exam processes to protect the security and integrity of our exams program. Future improvements in the works include diagnostic online practice test resources, expansion of test security analyses and website patrols, and improvements to exam administration security.
16 | PEG WINTER 2016
Made with FlippingBook flipbook maker