Riley Trottier
Riley Trottier
Senior Product Manager - building with artificial intelligence
PRODUCT

Guardrails for an AI Assistant

Five rules that keep an AI assistant from doing something slightly wrong under my name, and how each one is enforced.

I use an AI assistant for real work, and what worries me most is a small mistake made quietly under my name. So I gave it five rules:

  1. Check the writing before anything is sent.
  2. No invented numbers.
  3. Anything shared stays a draft until I say yes.
  4. Important documents go past a review panel.
  5. Corrections become rules, with my sign-off.
Five guardrails, each with the risk it covers and how it is enforced: a writing check before anything is sent, placeholders instead of invented numbers, drafts only for anything shared, a review panel for important documents, and corrections that become rules only with my sign-off
The five rules, what each one protects against, and how it's enforced.

The writing check is a hook. It stops the assistant from sending an email or chat message until the text has been through a pass that strips out AI writing habits, like stacked buzzwords and em dashes in every sentence. Messages to myself are exempt. I've had the same problem on my own projects. Claude drafted a LinkedIn intro for one of my posts that read like AI wrote it, and I rewrote most of it before posting. Now the same check runs on everything I publish, before I even see the draft.

When data is missing, the assistant writes a placeholder that says what's missing and where to get it. In my drafts that shows up as a bracketed note starting with NEED, so I can spot the gap when I read through. A made-up number that looks plausible is worse than an obvious hole, because nobody goes looking for it. It's the same reason I let plain code do the math in the products I work on.

The assistant can draft tickets, documents and calendar changes, but it can't create or change them until I've said yes to that specific change. A yes to one change doesn't carry over to the next. My blog works the same way - Claude gets each post ready, and nothing goes live until I say yes.

The review panel is for anything headed to leadership or an engineering handoff. It's a set of reviewer agents, and each one reads the draft the way a different person would:

  • an executive with five minutes
  • a skeptical engineer
  • a customer
  • an auditor
  • someone arguing the other side

What comes back is a list of questions I'd otherwise hear for the first time in the meeting. None of the reviewers can approve anything.

A draft in the middle with five reviewers around it: an executive with five minutes, a skeptical engineer, a customer, an auditor and someone arguing the other side. Their output is a list of questions, not an approval
The review panel. It produces questions, not approvals.

I use the same idea outside work. Before I turned on a monthly security scan for my own apps, I had a second agent review the plan, and it caught two things I'd missed.

Last, when I correct the assistant, it proposes a one-line change to its standing rules and waits for my yes. Rules don't change behind my back, and I don't have to make the same correction twice.

A flow: I correct the assistant, it proposes a one-line rule change, I approve or reject it, and an approved rule is saved and applies from the next session on
How a correction turns into a standing rule.

I've added two rules for my personal projects too:

  • Before anything I write goes public, the assistant scans it for work details that shouldn't be shared, and checks with me if it isn't sure.
  • It never types a password or creates an account for me, even when that would save a step.

The assistant is right most of the time, which makes it easy to stop checking. I started with tight limits, and I plan to loosen them one at a time where it's shown it doesn't need them.

Views are my own and don't represent Workday.

MORE DISPATCHES

PRODUCT

Building an AI Skills Library

Turning repeated AI instructions into versioned skill files, split across git repos, so a fix made once carries over to every task after it.

Oct 2026 · 3 min read
PRODUCT

Probabilistic Planner, Deterministic Executor

A design for AI features where every number has to be explainable. The model proposes, and plain code checks and carries it out.

Oct 2026 · 3 min read
BUILDING

Why I Shut Down Throughline

A personal dashboard built with Claude in September 2026, what went wrong with it, and why it was turned off after a few weeks.

Sep 2026 · 5 min read
← All dispatches