The Perils of AI in Legal Proceedings
Artificial intelligence (AI) has become a powerful tool in many fields, but its use in the legal profession has raised serious concerns. In South Africa, an AI tool was found to have fabricated case studies, leading to significant consequences for a legal team. This incident has sparked calls for clear guidelines and ethical standards in the use of AI within the legal system.
AI’s Role in Legal Research
In a case involving the High Court in Pietermaritzburg, lawyers used an AI chatbot called ChatGPT to find supplementary case examples for their arguments. The AI provided references that were later found to be non-existent in recognized legal databases. When the judge conducted an independent search using ChatGPT, he discovered that many of the cited cases were not real. As a result, the court ruled against the plaintiff, citing the lawyers’ failure to verify the accuracy of the AI-generated research.
A Growing Threat to the Legal Profession
Tayla Pinto, a lawyer specializing in AI, data protection, and IT law, highlighted the growing threat of unregulated AI use in legal practice. She noted that lawyers admitted to using generative AI without proper oversight, raising concerns about the ethical implications of such practices. According to Pinto, there have been multiple instances in South Africa where legal advisors have relied on AI-generated content in court documents, including cases involving a mining company and a defamation trial.
Human Error, Not Technological Failure
Pinto emphasized that the issue is not with the technology itself but with how it is being used. She pointed out that while tools like calculators and spell checkers have long been part of legal work, the current challenge lies in the responsible and ethical use of AI. Pinto stressed the need for legal professionals to ensure that their use of AI aligns with their ethical obligations and professional duties.
Consequences for the Legal Team
The case involved Philani Godfrey Mavundla, who was suspended as mayor of the Umvoti municipality. Although he initially won his case, the regional authority appealed, and the lawyers reportedly relied on AI-generated case studies. The court dismissed Mavundla’s appeal, criticizing the flawed and unprofessional nature of the legal pleadings. The judge ordered the law firm to pay additional costs, expressing disapproval of their submission of unverified evidence.
Regulatory Response and Awareness
The judgment was sent to the Legal Practice Council (LPC) for investigation, potentially leading to disciplinary action against the lawyers involved. Kabele Letebele, a spokesperson for the Legal Practice Court in Johannesburg, confirmed that while few formal complaints have been made, several cases are under review. He stated that the LPC believes existing rules are sufficient to handle AI-related issues, though ongoing discussions continue.
Letebele also urged legal practitioners to avoid blindly citing AI-generated caselaw, as inaccuracies could be deemed negligent and misleading. He reminded them that the LPC Law Library is available for free, allowing them to verify case law and legal research before submitting documents.
Calls for Ethical Guidelines
Mbekezeli Benjamin, a human rights lawyer, expressed concern over the increasing reliance on AI in legal arguments. He warned that judges may lose trust in the accuracy of legal submissions if they contain AI errors. Benjamin called for clear guidelines from the legal profession, including amendments to the Code of Conduct, to regulate AI use in judicial proceedings. He also suggested that excessive reliance on AI without verification should be considered professional misconduct, potentially leading to fines or removal from the legal register.
Conclusion
As AI continues to evolve, the legal profession must adapt to ensure that its use remains ethical and responsible. While AI can enhance efficiency, it cannot replace the critical thinking and verification processes that are essential to legal work. The recent incidents in South Africa serve as a cautionary tale, highlighting the need for vigilance, education, and regulatory clarity in the use of AI tools.
