Skip to main content

WeaverSol

NewProduction-grade MVPs in 7 days — book a free strategy call →

A rules-based workflow and an AI agent can both move a supplier invoice from an inbox into your accounting system. The difference shows up when the invoice arrives as a phone photo of a crumpled page, or when the supplier writes “please hold payment until the dispute is settled” halfway down the email.

Traditional automation does exactly what it was told and fails loudly when the input does not fit. An agent interprets, which makes it flexible and also capable of being confidently wrong. Choosing between them is mostly a matter of deciding which of those failure modes you can accept at each step of a process.

What each approach actually does

Traditional automation is a fixed sequence of steps: when a form is submitted, create a CRM record, send a confirmation, notify the sales channel. It can include branching logic, but every branch is written in advance. Given the same input, it produces the same output every time.

An AI agent uses a language model to decide what to do. It reads an input, works out what is being asked, chooses from a set of tools (look up an order, draft a reply, update a record) and decides when it has finished. The instructions describe goals and boundaries rather than every path.

Neither is a more advanced version of the other. They are different tools, and most useful systems contain both.

Where model judgment helps

Language models earn their cost wherever the input is messy and the rules are hard to write down.

  • Unstructured input. Emails, PDFs with inconsistent layouts, scanned forms, voice notes and chat messages. Writing parsing rules for every variation is impractical; a model handles the variation.
  • Varied language. Customers describe the same problem in dozens of ways, often in more than one language. “My order hasn’t come,” “still waiting on the parcel” and “tracking says delivered but nothing here” all need the same first step.
  • Classification and triage. Sorting inbound requests by type and urgency, routing leads, or flagging which contracts mention an unusual clause.
  • Summarizing and drafting. Condensing a long email thread before a call, or drafting a reply for a person to approve.

The common thread is that a small mistake is easy to catch and cheap to correct, and the alternative is a person reading every item.

Where model judgment hurts

The same flexibility becomes a liability where the answer must be exact, repeatable or auditable.

  • Calculations. Invoice totals, tax, commissions, payroll and stock levels belong in code. A model may produce the right number most of the time, and “most of the time” is not acceptable for money.
  • Compliance steps. Identity checks, consent records, retention rules and regulated disclosures need to run the same way every time, with a log that proves it.
  • Irreversible actions. Sending payments, deleting records or emailing your entire customer list should never depend on a model’s interpretation alone.
  • High-volume, low-variance work. If every input looks the same, such as a nightly CSV from a known system, a model adds cost and unpredictability without adding anything useful.

Cost and failure modes compared

The two approaches differ in more than capability.

  • Running cost. A deterministic workflow costs close to nothing per run beyond hosting. An agent pays for model calls on every run, and a multi-step agent can make several calls per task. At thousands of runs a day, that becomes a real line item.
  • Speed. Workflows typically finish in milliseconds to seconds. Agent steps take seconds each, which matters in a live chat or phone conversation.
  • How they fail. A workflow fails with an error: a missing field, a timeout. That is annoying but visible. An agent can fail by producing a plausible but wrong answer, which is harder to detect and needs deliberate checking.
  • Testing. Workflows can be tested with fixed inputs and expected outputs. Agents need evaluation sets: a few dozen real examples, run after every prompt or model change, with results reviewed.
  • Maintenance. Workflows break when a connected system changes. Agents can also drift when a model version changes, so pin versions and re-run evaluations before upgrading.

Hybrid designs: a deterministic spine with judgment at the edges

The pattern that holds up best in practice is a fixed workflow as the backbone, with model calls used only at the steps that need interpretation. The model reads and classifies; code calculates, validates and acts.

A worked example

Example (hypothetical): a property management company receives maintenance requests by email, WhatsApp and a web form across 300 units.

  1. A workflow collects every message into one queue, whatever the channel.
  2. A model extracts the unit, the type of issue and the urgency, and returns them as structured fields.
  3. Code validates the output: the unit must exist in the property database, and urgency must be one of four allowed values. Anything that fails validation goes to a person.
  4. A rules engine assigns the contractor based on issue type, location and the agreed rota. No judgment is needed here, so none is used.
  5. The model drafts an acknowledgment to the tenant in the tenant’s own language.
  6. A person approves any job estimated above an agreed threshold, and anything marked as an emergency, before it is dispatched.

Every step is logged, so when a tenant complains, the team can see exactly what was extracted, what rule fired and who approved it.

Where to put the human

Human review is most valuable at three points: when the model’s output fails validation, when the action is expensive or irreversible, and during the first weeks of operation, when you are still learning how often the model gets things wrong. Start with review on more steps than you think you need, track the approval rate, and remove checkpoints only when the data supports it.

A quick decision checklist

For each step in the process, ask the following:

  • Is the input structured and predictable? Use a workflow.
  • Does the step require reading free text, documents or speech? Use a model, with validated, structured output.
  • Does it involve money, compliance or an action you cannot undo? Keep it deterministic, with human approval where the stakes justify it.
  • Will it run thousands of times a day? Check the per-run model cost before committing.
  • Would a wrong answer be noticed quickly? If not, add a check or a review step.

Next step: map your process step by step

Pick one process that currently eats staff time and write out every step on a single page. Next to each, write “rule” if it can be expressed as a clear condition, or “judgment” if a person currently has to read and interpret something. The rule steps become your workflow; the judgment steps are where a model belongs, with validation and review around them.

If you want to see how that looks with your own data, we build a free working demo around one manual process within 24 hours of a first call. Our AI agents page explains how it works.

Leave a Reply

Your email address will not be published. Required fields are marked *