AI

AI for small law firms: why structure comes before tools

AI helps a small law firm only as much as its information is structured. An assistant asked to summarise a matter or draft a client update can only use what is recorded, so matters with current status, linked deadlines, actions with owners and captured research come first. Then start with low-risk internal uses, with human review and clear confidentiality rules.

By Raghav Handa · Updated 17 October 2026 · 3 min read

Why does AI disappoint so many small firms?

Because the context it needs is scattered across inboxes, folders and memory. Ask an AI for a matter status and it can only see the fragments you give it. The result sounds fluent and is often incomplete. The problem is not the model; it is the missing structure.

What does an AI-ready practice look like?

IngredientWhy AI needs it
Matter pages with current summariesThe starting context for any matter task
Deadlines as recordsAccurate digests and reminders
Actions with owners and statusReal next steps, not guesses
Time recorded by matterReliable reporting and billing drafts
Classified evidence and documentsGrounded summaries and chronologies
Captured researchAnswers from your own know-how

Which AI uses should a small firm start with?

  • Summarising a matter's history for an internal review.
  • Drafting a weekly client update for the lawyer to edit.
  • Compiling a deadlines and overdue-actions digest.
  • Turning attendance notes into action lists.
  • Tagging and summarising research notes.

What rules should govern AI use?

  1. Confidentiality: know where data goes and which tools may process client information.
  2. Verification: every citation, date and statement of law is checked by a lawyer.
  3. Supervision: AI output is treated like work from a junior colleague.
  4. Disclosure: follow your rules and any court requirements on AI use.
  5. Records: keep a short register of approved tools and uses.

How does this work in Notion?

Notion AI and Custom Agents can read your matters, deadlines and research directly when the workspace is structured, and the MatterOS prompt pack provides prompts to summarise a matter, draft a client update or build a next-steps checklist. The same prompts work with other assistants you use.

What is the difference structure makes to an AI output?

Ask the AIUnstructured practiceStructured practice
Summarise this matterGuesses from a few pasted emailsUses the summary, deadlines, actions and recent notes
What's due this week?Cannot knowLists recorded deadlines and owners
Draft a client updateGeneric textReflects this week's actual actions and requests
Have we researched this before?No ideaFinds the linked research note and its date

Which AI mistakes should small firms avoid?

  • Starting with client-facing uses before internal ones.
  • Pasting confidential material into tools whose data handling you have not reviewed.
  • Trusting citations or dates without checking them.
  • Expecting AI to fix missing records.
  • No written policy, so every lawyer makes different choices.

Frequently asked questions

Should small law firms use AI?
Yes, for internal drafting, summaries and digests with human review, once matters are structured and confidentiality rules are clear.
Why does AI give wrong answers about my matters?
Usually because the matter information is incomplete or scattered; AI can only use what is recorded.
Is it safe to use AI with client data?
It depends on the tool's data handling and your obligations. Review the vendor's security practices and your rules before use.
What is the first AI use case for a law firm?
A weekly internal digest of deadlines and overdue actions is low-risk and immediately useful.
Does MatterOS include AI?
MatterOS includes an AI prompt pack that works with Notion AI, Claude, ChatGPT or any assistant.

Sources

About the author

Raghav Handa

Raghav Handa trained as a lawyer, then spent years building legal technology, from enterprise legal products to custom systems for law firms.

Stop being the system

MatterOS connects matters, actions, time, team, evidence and research in one Notion workspace you own. $99, one payment, lifetime updates.

Get MatterOS · $99