Remember earlier this year when two legal scholars and scientists had GPT 3.5 take the multiple-choice portion of the bar exam and it failed to pass? Well, the second time’s a charm, as GPT has now passed not only the multiple-choice portion, but also the essay portion, and scored around the top 10% of test takers.
Only this time, it was the just-released GPT-4 taking the exam, the latest AI model from OpenAI that the company says “exhibits human-level performance on various professional and academic benchmarks.”
For this latest test, those two legal scholars and scientists, Daniel Martin Katz and Michael Bommarito, collaborated with the legal AI company Casetext, which recently launched the AI legal assistant CoCounsel, which Casetext has now confirmed is powered by GPT-4.
“GPT-4 leaps past the power of earlier language models,” said Pablo Arredondo, co-founder and chief innovation officer for Casetext. “The model’s ability not just to generate text, but to interpret
