本文是对AI领域近期重要文章 **Why do lawyers keep using ChatGPT?** (来源: The Verge AI) 的摘要与评论。

Original Summary:

The Verge article discusses the recurring issue of lawyers facing repercussions for submitting court filings containing inaccurate information generated by AI language models like ChatGPT. Lawyers are increasingly using LLMs for legal research, believing them to be time-saving tools. However, these models are prone to “hallucinations”—fabricating information and presenting it as fact. This leads to inaccurate filings, judicial sanctions, and ethical concerns. The article highlights the inherent risks of relying on AI without proper verification and fact-checking, emphasizing the need for lawyers to critically evaluate AI-generated content before using it in legal proceedings. The consequences underscore the crucial role of human oversight in the legal field despite advancements in AI technology.

Our Commentary:

The increasing use of ChatGPT and similar LLMs by lawyers, despite the known risks of inaccuracies, reveals a complex interplay between technological advancement and professional responsibility. While these tools offer potential efficiencies in research and drafting, the article’s examples demonstrate the serious consequences of blind faith in AI-generated content. The “hallucinations” problem highlights a critical limitation of current AI technology: its inability to reliably distinguish fact from fiction. This necessitates a shift in legal education and practice, emphasizing critical evaluation of AI-generated materials and the importance of rigorous fact-checking. The legal profession’s response will be crucial in shaping responsible AI adoption. Failure to address the ethical and practical challenges posed by AI could erode public trust in the legal system and potentially create new avenues for legal malpractice. The article serves as a cautionary tale, underlining the need for a balanced approach that leverages AI’s potential benefits while mitigating its inherent risks.

中文摘要：

The Verge的一篇文章讨论了律师因提交包含AI语言模型（如ChatGPT）生成的错误信息的法庭文件而面临处罚的反复出现的问题。律师们越来越多地使用大型语言模型进行法律研究，认为它们是节省时间的工具。然而，这些模型容易出现“幻觉”——编造信息并将其作为事实呈现。这导致文件不准确，司法制裁以及伦理问题。文章强调了依赖AI而不进行适当验证和事实核查的固有风险，强调了律师在法律程序中使用AI生成内容之前对其进行批判性评估的必要性。其后果突显了尽管AI技术进步，人工监督在法律领域中仍然至关重要的作用。

我们的评论：

律师们越来越多地使用ChatGPT和类似的大型语言模型，尽管已知其存在不准确的风险，但这反映了技术进步与专业责任之间复杂且相互作用的关系。虽然这些工具在研究和起草方面具有潜在的效率，但文章中的例子证明了盲目相信AI生成内容的严重后果。“幻觉”问题凸显了当前人工智能技术的关键局限性：无法可靠地区分事实与虚构。这需要法律教育和实践的转变，强调对AI生成材料进行批判性评估以及严格事实核查的重要性。法律界的回应对于塑造负责任的AI采用至关重要。未能解决AI带来的伦理和实践挑战可能会损害公众对法律体系的信任，并可能造成新的法律过失途径。本文起到了警示作用，强调需要采取平衡的方法，利用AI的潜在益处，同时减轻其固有的风险。

---

本文内容主要参考以下来源整理而成：

https://www.theverge.com/policy/677373/lawyers-chatgpt-hallucinations-ai