> ## Documentation Index
> Fetch the complete documentation index at: https://docs.exterview.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Running a Fair Pilot

> Design an Exterview pilot that validates scoring before you rely on it: the roughly 100-session calibration window, close human review, and clean expansion.

## Purpose

A pilot exists to confirm that scoring lands correctly for your organization before you lean on it for high-stakes decisions. The most important design choice is running enough volume to trust the calibration.

## The calibration window

Scoring is calibrated to your organization during [Foundation](/configure/foundation), but calibration is only confirmed by running it. Treat your first phase, up to about 100 evaluation sessions, as a calibration-validation window.

<Note>
  Below roughly 100 sessions, treat scores as directional and keep human review
  especially close. Reserve high-stakes reliance for after scoring is confirmed
  at that volume. This is a hard gate on the [Production
  Checklist](/deploy/production-checklist).
</Note>

## Designing the pilot

<Steps>
  <Step title="Pick one role with real volume">
    Choose a role that will actually generate around 100 sessions in the pilot
    window, so calibration has something to validate against.
  </Step>

  <Step title="Keep a human close on every decision">
    During the window, review evidence on every evaluation, not a sample. This
    is how you catch calibration issues early.
  </Step>

  <Step title="Track agreement">
    Compare reviewer judgment with the score. Persistent disagreement on a
    dimension is a calibration signal, not noise to ignore.
  </Step>

  <Step title="Confirm, then expand">
    Once scoring is confirmed at volume, expand to more roles and departments.
    See [Enterprise Rollout](/best-practices/enterprise-rollout).
  </Step>
</Steps>

## What good looks like

<CardGroup cols={2}>
  <Card title="Enough volume">
    Around 100 sessions on the pilot role before high-stakes reliance.
  </Card>

  <Card title="Close review">
    Human review on every evaluation during the window.
  </Card>

  <Card title="Documented agreement">
    A record of where reviewers and scores agreed and diverged.
  </Card>

  <Card title="Deliberate expansion">
    Expansion only after calibration is confirmed, not before.
  </Card>
</CardGroup>

## Related

<CardGroup cols={2}>
  <Card title="Calibration" href="/monitor/calibration">
    How scoring stays reproducible as evaluations run.
  </Card>

  <Card title="Go-Live Readiness" href="/configure/go-live-readiness">
    Clearing setup before the first live session.
  </Card>

  <Card title="Production Checklist" href="/deploy/production-checklist">
    The gate where the volume threshold lives.
  </Card>

  <Card title="Enterprise Rollout" href="/best-practices/enterprise-rollout">
    Expanding after the pilot.
  </Card>
</CardGroup>