Source: Jewish Press

Israel’s High Court has rejected a legal plea that was written by an artificial intelligence system after it was discovered that the AI-generated document contained fabricated legal citations. The case highlights the growing concerns over AI-generated legal arguments and their reliability in courtrooms.

The plea was submitted by a lawyer who used an AI tool to draft legal arguments but failed to verify the accuracy of the citations included. Upon review, the court found that some of the legal precedents referenced in the AI-generated plea did not actually exist.

This case echoes similar incidents in other countries, where AI-powered legal research tools have been found to generate misleading or entirely false citations. The ruling reinforces the importance of human oversight in AI-assisted legal work.

Legal experts warn that while AI can streamline legal research and document drafting, it should not be relied upon without thorough verification. Some courts are now considering requiring lawyers to disclose when AI tools have been used in legal submissions.

The article concludes that the rise of AI in law presents both opportunities and risks. While AI can enhance efficiency, its limitations—such as the tendency to "hallucinate" facts—pose serious risks in legal proceedings. Israel’s ruling may influence future AI regulations in the legal sector.