California Bar Exam Faces Backlash Over AI-Generated Questions
California Bar Exam Faces Backlash Over AI-Generated Questions
Might want to look at Item 7001 on the California State Bar ...
The California bar exam controversy in February 2025 has sparked significant outrage after the State Bar of California admitted to using artificial intelligence (AI) to develop a portion of the multiple-choice questions. This revelation came amidst widespread complaints about technical issues and irregularities during the exam administration.
According to the State Bar, 23 of the 171 scored multiple-choice questions were developed with AI assistance by ACS Ventures, its independent psychometrician. Additionally, 48 questions were recycled from a first-year law student exam, and 100 were created by Kaplan Exam Services, a test prep company contracted by the State Bar. The State Bar defended its practices, stating that all questions underwent review by content validation panels and subject matter experts for legal accuracy, minimum competence, and potential bias.
However, legal education experts and faculty members have expressed strong criticism. Mary Basick, assistant dean of academic skills at UC Irvine Law School, called the use of AI "unbelievable," while Katie Moran, an associate professor at the University of San Francisco School of Law, described it as "a staggering admission." Critics argue that using AI-generated questions drafted by non-lawyers represents a conflict of interest, as the same company responsible for creating the questions also evaluated their validity.
The controversy has been compounded by other issues during the exam, including technical glitches, typos, and confusing questions, which led to a federal lawsuit against Meazure Learning, the exam administrator. The California Supreme Court, which oversees the State Bar, was reportedly unaware of the AI involvement until the State Bar's press release.
In response to the backlash, the State Bar plans to ask the California Supreme Court to adjust test scores for February exam takers. However, it has resisted calls to revert to the National Conference of Bar Examiners' Multistate Bar Examination, citing test security concerns with remote testing options. The Committee of Bar Examiners is set to meet on May 5 to discuss potential remedies.
This incident highlights the challenges of integrating AI into high-stakes testing and raises questions about transparency, accountability, and the quality of exam questions in the legal licensing process.
Invite Gmail Contacts
