LITERATURE REVIEW

1. ChatGPT goes to law school.

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4335905
This literature review discusses about the implications of using ChatGPT in law
schools. ChatGPT is an AI language model produced by OpenAI which was released
in late 2022. GPT models, including ChatGPT, are “autoregressive" in nature,
meaning that they predict the next word given a body of text. Although ChatGPT was
trained on a large general-purpose corpus, it performs surprisingly well on specific
technical tasks. Open AI has produced significantly larger language models. To know
how well can AI models write law school exams without human assistance, ChatGPT
was publicized to generate answers on four real exams in the University of Minnesota
Law School. The courses were Constitutional Law: Federalism and Separation of
Powers, Employee Benefits, Taxation, and Torts. One of the authors generated all of
these answers using ChatGPT and formatted them to match actual exams written by
students. The AI-generated exams were then shuffled with actual student. Each exam
slightly differed in format and context. For multiple choice questions, two alternative
prompting methods found to perform well with GPT models in past work: “chain-of-
thought” (CoT) prompting and “rank-order. Overall, ChatGPT passed all four classes
based on its final exam, averaging a C+ across all exams, an outcome which would
earn credit toward the JD but place the student on academic probation. The authors
used ChatGPT to compose exam answers without adapting our prompts to any
specific course or exam question. With respect to the essays, ChatGPT’s performance
was highly uneven. With respect to the multiple choice questions, ChatGPT generally
performed worse than on the essays but still statistically significantly better than
chance. In writing essays, ChatGPT displayed a strong grasp of basic legal rules and
had consistently solid organization and composition. It did a good job of accurately
summarizing appropriate legal doctrines. ChatGPT produced text with no
grammatical errors or typos. It also structured sentences and paragraphs well.
However, it struggled to identify relevant issues. One of the biggest problems with
ChatGPT’s essays was that they failed to go into sufficient detail when applying legal
rules to the facts contained within exam hypotheticals. What do our results mean for
legal education? We expect that ChatGPT could substantially improve the
 performance of students on exams. We also expect that language models will become
helpful tools for practicing lawyers. To understand prompts and prompt engineering
for legal writing certain aspects such as specifying tone, generating citations, writing
longer essays and general prompt engineering were taken into account.

2. Some law professors fear ChatGPT's rise as others see opportunity.

https://www.reuters.com/legal/legalindustry/some-law-professors-fear-chatgpts-rise-
others-see-opportunity-2023-01-10/
The artificial intelligence program ChatGPT came up short last month on the multiple
choice portion of the bar exam. The AI bot performed better than predicted by earning
passing scores on evidence and torts. It is expected that it will pass the attorney
license test someday. Law professors are delighted by the fact that it can write better
than expected as the bot generates human-like responses based on data given by the
users. Daniel Linna, director of law and technology initiatives at Northwestern
University Pritzker School of Law, said most law professors think that language-
based AI tools are concerned with students passing off work generated by the chatbot
as their own. But others see AI as a tool for legal education and without its help,
students may be unprepared for their legal careers. He also said that ChatGPT is not
yet sophisticated enough. Andrew Perlman, dean of Suffolk University Law
School, stated that he would like to see legal research and writing classes cover the
use of tools like ChatGPT. Jake Heller, chief executive officer of legal tech company
Casetext, stated that law schools should encourage students to use ChatGPT and
similar tools as a starting point for documents. But, there are skeptics and among them
is, South Texas College of Law Houston law professor, Josh Blackman, who urged
professors to rethink take-home exams in a recent post on the Volokh Conspiracy
blog. There are mixed responses with regard to the usage of the AI model.

3. ChatGPT clears law school exam in the US, writes essays on taxation and
constitution.
https://www.indiatimes.com/trending/jugaad/chatgpt-clears-law-school-exam-in-us-
writes-essays-on-taxation-constitution-591291.html
Open AI's ChatGPT uses AI to make text streams in response to simple commands.
The results have been extremely impressive and teachers are concerned about the
same as it can end the traditional classroom education. This bot was able to get a
 passing grade but it was near the bottom of the class. The essays provided by
ChatGPT demonstrated a strong understanding of basic legal rules and were well-
organized. But, the bot struggled to spot issues when given an open-ended prompt (a
core skill on law school exams). Choi said that ChatGPT might be a good way to
teach (even though official in New York and other places have banned its use). It can
be said that language models like ChatGPT would be very useful to law students
taking exams and practicing lawyers.

4. Using ChatGPT to write law school exams, bar exams and strategic plans.
https://taxprof.typepad.com/taxprof_blog/2023/01/the-use-of-chatgpt-in-law-school-
exams-bar-exams-and-strategic-plans-.html
This literature discusses about using ChatGPT to write law school exams. The
artificial intelligence program ChatGPT came up short last month on the multiple
choice portion of the bar exam. The AI bot performed better than predicted by earning
passing scores on evidence and torts. It is expected that it will pass the attorney
license test someday. Law professors are delighted by the fact that it can write better
than expected as the bot generates human-like responses based on data given by the
users. Daniel Linna, director of law and technology initiatives at Northwestern
University Pritzker School of Law, said most law professors think that language-
based AI tools are concerned with students passing off work generated by the chatbot
as their own. But others see AI as a tool for legal education and without its help,
students may be unprepared for their legal careers. Andrew Perlman, dean of Suffolk
University Law School, stated that he would like to see legal research and writing
classes cover the use of tools like ChatGPT.

5. The AI revolution demands radical change to law curricula.

https://www.timeshighereducation.com/blog/ai-revolution-demands-radical-change-
law-curricula
This literature review discusses about the AI revolution which demands a radical
change to law curricula. ChatGPT is the next generation AI text generation bot. The
author tried the AI tool with the take-home exam and found reasonable answers. For
example, whether the law should be reformed, the bot showed its capability to
produce fluent and confident answers that examined various viewpoints and even
cited UK and international cases. But, none of the answered produced by ChatGPT
 would be deemed first-class standard because it mainly lacks critical analysis.
However, there were not many answers with substantial errors and with the help of
reasonable knowledge, one could certainly pass. There are questions related to the
violation of academic integrity around the usage of the AI tools. In order to conserve
the academic values, universities may have to update their policies. The most
important question which arises is what ChatGPT means for legal education today. AI
is being used for various purposes which help in making research easier in the legal
field. A handful of law schools are beginning to introduce AI, big data, blockchain etc
so as to help law students understand and become prepared to use new technologies in
their future work. These courses will help the lawyers understand the various legal
risks associated with such technologies. With the growth of ChatGPT's capabilities, it
will not only be able to produce a decent legal opinion but also write code faster and
potentially better than legal engineers can.

6. Coping with ChatGPT.

https://www.insidehighered.com/blogs/law-policy%E2%80%94and-it/coping-chatgpt
The internet has provided new tools to law schools. Professor Peter Martin, who
established the Cornell’s Law Information Institute, influenced the curriculum about
legal research and writing to take into account the new tools provided by the internet.
In order to evade academic integrity violations, multiple-choice tests were avoided. A
solution to this problem was take home essays that comprehensively synthesized the
materials and resources of the course. There is a significant transition which helps us
to understand the importance of academic integrity. Entering into ChatGPT, the new
artificially intelligent tool is upending testing. The question arises with regard to the
academic integrity in the light of new development. In order to understand the usage
of ChatGPT in depth, the author mentions its necessity as well as its contravention.
Professor Martin says that, "education/learning will no longer be about how much an
individual can absorb but how to find information." There is a crisis/opportunity
moment. Some universities and colleges perceive crisis but there is an underlying
opportunity which will provide us with the chance of viewing ourselves as those
tasked with the privilege of imparting “knowledge” and “learning.” Artificial
intelligence is going to play an important role in the upcoming years. It is an
opportunity for us to maximize innovation while keeping ethics intact.