Judgment Coaching Mode

Judgment Coaching Mode is how DelegateZero closes the context gap faster than passive correction. When the system detects a pattern of overrides in a decision category, it stops trying to guess and starts asking - one specific question per decision, until it earns enough confidence to act autonomously.

Judgment Coaching Mode is available on the Operator plan and above.

What triggers coaching

Coaching is triggered automatically when DelegateZero detects 3 or more overrides in a single decision category within 30 days. Categories are derived from request patterns - not user-defined buckets. DelegateZero clusters decisions by semantic similarity of the request type and outcome, then generates a human-readable label (e.g. "Refund requests for high-tenure accounts").

When coaching activates, you receive an email notification and the category appears on your Coaching dashboard. No configuration required.

The coaching response

When a decision falls into an active coaching category, the API returns a coach decision type instead of execute, draft, or escalate. The response payload includes:

  • decision: "coach"
  • lean: what the system would have decided without your input (execute / draft / escalate)
  • confidence: the confidence score on that lean
  • reasoning: what the system sees - the signals, patterns, and context that informed the lean
  • gap: the specific thing the system is uncertain about
  • follow_up: a single, specific question targeting the gap

The lean is always stated before the question. You can see exactly what the system would have done without your input - which is the most useful feedback loop.

To respond to a coaching request, call POST /api/v1/decisions/{id}/coach-response with a response field. DelegateZero folds your response into the context, completes the decision, and records whether your input changed the outcome.

Coaching never blocks operations. If a coaching session receives no response within 24 hours, the decision escalates automatically.

API reference

Coach decision payload

{
  "decision": "coach",
  "lean": "execute",
  "confidence": 0.71,
  "reasoning": "This looks like a standard refund request within the 30-day window. The account has no prior refund history.",
  "gap": "Unsure whether the recent support ticket changes the calculus on this one.",
  "follow_up": "This account opened a chargeback dispute 2 weeks ago. Is there context about how that resolved that I should factor in here?",
  "title": "Refund request review",
  "summary": "Standard refund request flagged for coaching due to recent account activity.",
  "id": "...",
  "audit_url": "https://delegatezero.com/app/decisions/..."
}

POST /api/v1/decisions/{id}/coach-response

// Request
{
  "response": "The chargeback was resolved in our favor. Proceed with the standard refund policy."
}

// Response - standard decision payload
{
  "status": "complete",
  "decision": "execute",
  "confidence": 0.89,
  "reason": "...",
  "response": "...",
  "id": "...",
  "audit_url": "..."
}

Webhooks

Two webhook events are available for coaching:

  • decision.coaching_requested - fires when a decision enters coaching mode. Payload includes the full coaching payload (lean, reasoning, gap, follow_up) and the coach_response_url.
  • decision.coaching_graduated - fires when a category graduates from coaching to autonomous mode. Payload includes the category label, session count, and final confidence score.

Configure coaching webhooks from the API & Webhooks settings page.

Graduation

Coaching Mode exits automatically when confidence on a category crosses the exit threshold for N consecutive sessions. Defaults: 0.85 confidence threshold, 5 consecutive sessions. Both values are configurable per category from the Coaching dashboard.

When a category graduates, DelegateZero sends an email and fires the decision.coaching_graduated webhook. The system then handles that category autonomously - override rights remain in place, and coaching can be re-activated automatically if a new override pattern emerges.

You can also graduate a category manually at any time from the Coaching dashboard.

Coaching controls

From the Coaching dashboard (/app/coaching):

  • View all active, graduated, and paused coaching categories
  • Respond to pending coaching sessions
  • Pause coaching on a category (reverts to escalate for that category)
  • Graduate a category manually
  • Adjust the exit threshold and streak requirement per category

There are no results for that search on this page, however, if you press the enter key then our entire documentation will be searched and you will receive the results. If you need assistance, please contact us.