Generative artificial intelligence (GenAI) has significantly impacted education, including legal instruction. Leveraging AI, law students gain efficient comprehension of legal documents and cases, leading to more informed legal opinions. Legal professionals can enhance predictive analytics accuracy by identifying patterns within legal data. However, attention often focuses on advantages while overlooking potential downsides. This topic explores challenges posed by AI hallucinations and biases in education, specifically legal teaching.

GenAI models, like ChatGPT, that are trained to understand and produce human language content which may generate false information. This phenomenon is particularly concerning in fields requiring high precision, such as law. Legal hallucinations raise ‘significant concerns’ about the reliability of using large language models in the field. Such inaccuracy, no matter false positive or false negative, can lead to serious consequences on legal case outcome. This paper delves into content generation, reliability, and consequences for students and educators, proposing strategies to mitigate biases while harnessing AI benefits in the classroom

Keywords: Technology, GenAI, hallucination, downside, drawback, disadvantage, legal education.