Glossary · AI

What is Human in the Loop?

Definition

Human in the loop is a design pattern where a person reviews, approves or corrects an AI system's output at defined points before it takes effect. The AI prepares the work, such as a drafted reply, an extracted record or a proposed action, and a person accepts, edits or rejects it. Review can apply to every item or only to uncertain or high-risk cases.

Why it matters for your business

Human review is how most businesses get value from AI before they fully trust it. It limits the damage from errors, creates a record of corrections that can improve prompts and evals, and keeps a person accountable for decisions that matter, such as payments, hiring or medical advice. The design question is where to place the checkpoint. Reviewing everything can erase the time savings, so many systems route only low-confidence items, high-value transactions or sensitive categories to a person and let the rest flow through.

Example

An accounts receivable team uses AI to draft collection emails for overdue invoices. Reminders for invoices less than 15 days late go out automatically with standard wording. Anything over 60 days, above a set dollar amount, or for a customer with an open dispute is drafted by the AI but waits in a queue for the collections manager to edit and send.

Next steps