Skip to content
Reference architectures
Reference architectureDesign intent

A sensitivity-aware AI router

Deciding, request by request, where each task may run and what may leave the organization.

OceanBlu · 15 October 2026 · 5 min read

Problem

An organization using several AI models needs a consistent rule for where each request goes. Ad-hoc choices leak sensitive data or waste money.

Flow

  1. Classify the request and attached context by sensitivity (public, internal, restricted) and by difficulty.
  2. Check policy: which deployment targets are permitted for this workspace and class?
  3. Keep restricted work inside the organization's environment.
  4. Mask names, numbers and identifiers before any permitted external call; unmask the response internally.
  5. Escalate to a stronger model only when confidence is low and policy allows.
  6. Log the route taken and why.

Policy table

Data classPrivate modelCloud model
PublicYesYes
InternalYesIf the workspace allows, with masking where required
RestrictedYesNever

Evaluation

A router is only as good as its tests. We define a test set per organization — including Bangla, English and mixed-language questions — and measure quality by route, the rate of policy violations (target: zero) and latency. No figures are published before they are measured.

Trade-offs

Masking can remove context a model needs. The policy therefore lets an owner decide, per workspace, which routes are worth it.

Start a conversation

Let's explore what comes next.

Tell us about the organization, system or market you are thinking about. We start with questions, not a price list.

Start a conversation