Lesson 06 / Beginner to intermediate / 25 min
When Should You Use an Agent?
Learn to evaluate use cases, weigh the trade-offs, and decide whether an agent is worth building.
LEARNING OBJECTIVES
- — Evaluate a proposed use case with a structured set of questions
- — Weigh cost, reliability, privacy, and oversight trade-offs
- — Recommend the simplest approach that fits a scenario
- — Produce a complete design specification for a simple assistant
Prerequisites: Lesson 05 — Understanding Agent Architecture
The evaluation questions
Before anyone builds an agent, walk through these questions. They separate genuine opportunities from expensive science projects.
- Is the task repeated frequently? A one-off task rarely justifies an agent.
- Does it require interpreting unstructured information — emails, documents, free-text requests?
- Does it involve several steps that depend on each other?
- Are the necessary tools and data actually available and permitted?
- Can success be measured? If you cannot tell a good outcome from a bad one, you cannot evaluate the system.
- What happens when the system makes a mistake? Who notices, and what does it cost?
- Could ordinary automation solve it more simply?
- What level of human approval is necessary, and who provides it?
The trade-offs
Agents buy flexibility with complexity. Count the cost honestly:
- Development cost: an agent needs instructions, tools, validation, and evaluation — more than a script.
- Operating cost: every model call costs money or compute; multi-step tasks multiply it.
- Latency: a loop of model calls is slower than a direct rule.
- Reliability: model behavior varies; you must test failure cases, not just happy paths.
- Maintenance: models, data, and tools change; behavior must be re-checked over time.
- Privacy: whatever enters the context may leave your systems, depending on where the model runs.
- Security: every tool is an attack surface; untrusted input can try to redirect the agent.
- Human oversight: someone must review outcomes, especially early on. Budget for it.
Recommending an approach
For any scenario, your recommendation should be one of five: traditional automation, an AI model, an AI-assisted workflow (automation with a model step), an AI agent, or a human-led process. The right answer depends on the actual requirements, risks, and permissions — not on how impressive the technology sounds.
Automatically issuing refunds, for example, is usually a poor agent candidate: the action is sensitive, the rules can be made explicit, and mistakes cost money. Categorizing incoming emails, by contrast, is a classic fit: frequent, unstructured, multi-step, and easy to review.
Capstone: design your assistant
Time to finish The First AI Assistant. In the exercise below you will produce a complete design specification: the problem, the user, the outcome, the context, the tools, the permission boundaries, the human approval points, the failure handling, and the success criteria.
The result is a learning exercise, not a validated production architecture — but every field you fill in is a question a real project must answer.
Course summary
You can now explain what an agent is, tell it apart from models and automation, trace its execution cycle, configure its instructions, context, tools, and permissions, sketch its architecture, and evaluate whether a use case deserves one. That is the complete foundation — everything else in AI engineering builds on these six ideas.
When you are ready to go further, the guided project Build Your First AI Agent implements this flow in Python with a deterministic demo you can run without any paid account.
INTERACTIVE EXERCISE
Assess the use cases
Five fictional business scenarios. For each, choose the approach you would recommend — then read the reasoning. There is room for professional disagreement; the explanations show the thinking, not just the verdict.
01Categorizing thousands of incoming customer emails by topic and urgency, every day.
02Producing a weekly sales report from approved figures in the company database.
03Answering employee questions from a large collection of internal policy documents.
04Automatically issuing refunds to customers who ask for one.
05Summarizing a stack of customer feedback comments into themes for a quarterly review.
CAPSTONE EXERCISE
Capstone: The First AI Assistant, specified
Design a simple AI assistant for one of the fictional use cases above — or for the document organizer you have been developing throughout the course. Fill in every field; the summary at the end is your design specification.
Fill in all 9 fields to generate your summary (0 done so far).
Glossary.
- Use case
- A specific task or problem you are considering solving with a system.
- Latency
- The delay between a request and its response.
- Human-led process
- Keeping people in charge of the task, with software assisting rather than acting.
- Success criteria
- The measurable conditions that tell you whether the system is doing its job.
Check your understanding.
5 questions. You get an explanation after every answer, and you can change your answer to try again.
Saved in this browser only.
Need help implementing an intelligent workflow?
Explore AI Agents & Automation