Notes on the Computer Based AICP Exam

By Paul Farmer, FAICP
Executive Director

Several years ago, the AICP Commission directed staff to move toward a computer-based exam that could be administered more widely and over two "windows" each year rather than only on a single day. This makes the exam more accessible and enables an exam that includes more graphics, such as maps and site plans. In 2004, computer-based exams were administered during two 12-day-long testing "windows," once in the spring and once in the fall.

Until 2004, AICP administered a single exam on a single day. In 2004, we administered exams on 24 days during the calendar year. Obviously, we can no longer use a single exam. In preparation for the computer based exams, the AICP Exam Committee worked very hard to generate many new questions — enough to make up three exams. Questions in each version of the exam were assembled using the same subject matter outline.

These three exams were administered on a single day in May 2003. Each test site had all three exams available and they were randomly assigned to candidates at each site. It is highly likely that test-takers at each test site took different exams. Different exams were not administered based on the test sites; each site had multiple exams.

The multiple exams were administered to provide experience to AICP on issues concerning administration of separate exams in preparation for the roll-out of the computer-based exams in 2004, including the number of questions required for such administration. The consultants employed by AICP (Thomson-Prometric) are very experienced in all aspects of standardized testing. AICP and its Exam Committee requested and received assurances that exams would be equivalent in all aspects, including distribution of questions by subject matter category and difficulty of questions. Each form of the exam, therefore, includes the same context, allowing candidates to use the same study materials. Following the examination, "equating procedures" were employed that adjusted test scores on separate exam versions to compensate for differences in their relative difficulty.

From year to year, some questions are repeated (known as "equators"). These permit statistical operations to assure the equivalence of exams from year to year. The same operations assure equivalence among the three exams. A very rigorous process is employed in developing the passing score, known as the "cut score."] It is an operation undertaken every few years and the statistical operations described assure the equivalence of the exam from year to year.

Click here to read an explanation of passing points and test equating.

Becoming an AICP Member

Achievement and a commitment to a lifetime of sound, ethical practice are essential components of AICP membership. I would like to extend my appreciation to all involved in the exam and certification process: the candidates, the Commission and its Exam Committee, and those who have provided education and mentoring to others.

I would also like to invite you to offer comments; we are always looking for ways to improve our process. Should you have comments or questions, don't hesitate to contact Don Krueckeberg, FAICP, Committee Chair (krueckeb@rci.rutgers.edu) or me (pfarmer@planning.org).