When the Record Is Incomplete, Legal AI Should Say So
How legal AI should handle insufficient evidence, conflicting accounts, missing documents and unread material without producing a complete-looking answer.

Sometimes the material does not support an answer. A legal AI system should preserve that condition instead of smoothing it into a conclusion. This is a difficult product requirement because fluent models are built to respond. The user asks what happened, who was responsible or whether an allegation is supported. A complete sentence can appear even where the evidentiary record is incomplete. For litigation, the absence of a reliable answer can itself be useful. It tells the lawyer what remains to be investigated, requested or tested.
Insufficient evidence is different from a difficult question
A difficult question may have an answer in the supplied material that is hard to find or reason through. An insufficient question cannot be resolved from the material provided. A relevant witness statement may be missing. The documents may establish two possible dates without resolving which is correct. The only support may be an allegation by an interested party. A PDF may have failed during processing. The system needs to distinguish those situations.
Research published in 2026 gives a useful example. Learning When Not to Decide tested AI systems in unemployment insurance adjudication using cases where the information required for a determination was deliberately varied. Standard RAG approaches averaged 15% accuracy when information was insufficient. A structured method that required the system to identify missing information before making a determination reached 89% overall accuracy. That study concerns administrative adjudication, not litigation fact extraction. The transferable point is narrower: forcing an explicit evidence-completeness check before the conclusion materially changed the system's behavior.
Six states the system should keep separate
Mary proposes six factual states for incomplete or contested legal records:
- Supported: the available material supports the proposition, subject to any stated qualification.
- Alleged: a source asserts the proposition, but the supplied record does not independently establish it.
- Conflicted: material sources provide inconsistent accounts that cannot yet be reconciled.
- Insufficient: the available evidence does not permit a responsible conclusion.
- Expected but missing: the record refers to a document, event or period that would ordinarily be expected, but the material was not supplied.
- Unread or failed: the source was present, but the system could not process it reliably.
Those states call for different responses. An allegation may still be highly relevant. A conflict may become the center of cross-examination. A missing attachment may justify a request for production. An unread scan may require OCR or manual review. Combining them under a generic label such as "low confidence" loses the reason for the uncertainty.
A source link does not solve completeness
A cited answer can be accurate as far as it goes. The cited email may support that a meeting occurred. Another document outside the model's selected context may place the meeting on a different day. A missing attachment may contain the terms discussed. The source link helps the lawyer check the stated proposition, but it does not show the coverage of the inquiry. The product should expose both:
- the evidence supporting the answer;
- the scope and limits of the material considered.
That includes documents that failed, date ranges with no material, expected sources that were absent and relevant accounts that conflict with the answer. The real-source article separates source existence from faithful use and matter coverage.
The evidence check should happen before generation
An effective workflow can require the system to complete an evidence checklist before producing the answer. For a question about whether a notice was given, the checklist might ask:
- Is there a document recording the notice?
- Is there evidence of delivery?
- Does the recipient acknowledge receipt?
- Are the relevant date and contractual requirement available?
- Does any source contradict the proposed conclusion?
The model may help identify and populate those fields. The system should retain the fields and their sources rather than hiding them inside internal reasoning. If a required field is absent, the output can say what is missing and why the conclusion is being withheld. That is more useful than a generic disclaimer.
The system should ask a targeted follow-up
A non-answer should move the work forward. "Insufficient information" on its own gives the lawyer little direction. A stronger response identifies the missing premise:
- the document refers to Schedule 2, but Schedule 2 was not supplied;
- the bank records cover January to March and resume in June, leaving April and May unaccounted for;
- the allegation is supported only by the claimant's later statement;
- two witnesses give different dates and no contemporaneous record resolves the difference.
The lawyer can then decide whether to seek another document, question a witness, preserve the conflict or proceed on an express assumption. The system should not decide the legal consequence of the gap unless that task has been assigned and the necessary legal context is available.
Missing evidence is not adverse evidence
A missing document does not prove concealment. A silent period in communications does not establish that nothing happened. An absent record may reflect collection scope, retention practices, privilege, processing failure or a genuine evidentiary gap. The product should report the observable condition and avoid importing an inference that the evidence does not support. Discovery makes the separation especially important. Federal Rule of Civil Procedure 26 requires parties to address discoverable information, proportionality and sources that are not reasonably accessible. The legal consequence of unavailable or withheld material depends on the circumstances and the applicable rules. Software can identify the gap; the lawyer determines what it means and what step follows.
Test the non-answer as carefully as the answer
A known-matter evaluation should include questions that cannot be answered from the supplied record. Measure whether the product:
- recognizes that information is insufficient;
- identifies the missing premise;
- avoids inventing a bridge between the available facts;
- preserves conflicting accounts;
- distinguishes missing material from processing failure;
- returns to the question correctly when the missing source is later supplied.
A system can improve its apparent precision by refusing too often. The test should include clear cases as well as incomplete ones. The paper on the "detection-to-abstention gap" makes a related point: a reasoning model may recognize that a problem is underspecified and still continue to a confident answer. The control has to affect the final action, not merely appear in the hidden reasoning.
What this looks like in the factual record
An incomplete record should remain structured. The fact can be stored with its source, status and open question. Expected missing material can be attached to the relevant issue or period. When the document later arrives, the system can propose an update without erasing the earlier uncertainty or the steps taken because of it. That is one reason Mary treats gaps, contradictions and allegations as part of the record rather than defects to be removed from the final prose.
The known-matter test provides a method for measuring this behavior. Checking the AI is not enough shows how negative space and page-level review appear in practice.