Skip to content
DocketDocket
← Your pathLevel 1 · Beginner

Why the model invents a case that sounds exactly right

Lesson 1 of 6 · Verify before you file

1 · Learn the move · Context + audience

A language model does not look a case up. It produces the next likely word, and the most likely words after 'see' in a brief are a party name, a reporter, a volume and a page. That is why the invented case is never a wild one: it has plausible parties, a real reporter, a volume in range, a year that fits, and a parenthetical that says exactly what your argument needs. Fluency is the symptom, not the proof. The courts that have sanctioned lawyers for this did not sanction them for using a model; they sanctioned them for filing what it wrote without opening it [S]. Rule 3.3 makes a false statement of law to a tribunal the lawyer's own [M], and Rule 11 puts the certification on the signature, not on the tool [M]. So the habit this desk builds is not 'never use it'. It is: everything that looks like an authority is a claim about the world until a person has opened the source and read the passage. Tell the model who it is writing for (a lawyer who will open every cite) and what it must do with anything it cannot open (mark it), and the output changes shape.

You are drafting for a lawyer who will open every authority you cite before it is filed. Write the argument section below. For every case, statute, rule or regulation you cite, append [VERIFY] and, in one clause, say what you believe it holds. Never quote a case; paraphrase and mark it [NO QUOTATION: unseen]. If you are not confident an authority exists, write [AUTHORITY NEEDED: the proposition] instead of a citation. Argument: [paste the de-identified facts and the proposition]

2 · Your turn. You write the prompt

A second-year associate at Marchetti & Ostrow drafted the opposition to a motion to dismiss with a chatbot in forty minutes. It cites nine cases. Three are real and on point, two are real and say something else, four do not exist. The partner caught one of the four by chance. She wants the associate to understand what happened before she explains what happens next.

Write the prompt for this scenario as given, or swap in a real one from your own work. The score works the same either way.

Remember: the AI sees only your prompt, not this page. If the situation isn't in your prompt, it doesn't exist.

Optional. These shape the output when you run your prompt below, not your score.