Skip to content

Commit fe0102b

Browse files
Hou Chi ChanCopilot
andcommitted
docs: distinguish evaluation throughput from live-send capacity
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 7c454360-a88e-447c-9158-ba68d9ba6ede
1 parent 994f543 commit fe0102b

1 file changed

Lines changed: 20 additions & 8 deletions

File tree

‎docs/FRONTDOOR.md‎

Lines changed: 20 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -135,11 +135,20 @@ Autoscale maxima, provisioned instance counts, and approved quotas alone are **n
135135
Pass only against agreed latency/error and sustained-load criteria with measured evidence in
136136
both directions. No measured production-capacity result is supplied by this guide.
137137

138-
Encrypted evaluation load validates authentication, decryption, and routing without sending OTPs;
139-
it does not exercise provider delivery throughput. Provider/dependency capacity and live-path
140-
behavior need separate approved evidence before the release capacity gate can pass. Do not turn
141-
the non-delivering drill into a live-send load test. Evaluate cold starts, cache expiry, and
142-
credential/key refresh so warm caches do not hide a dependency on the failed region.
138+
Encrypted evaluation requests bypass request-path provider credential resolution and outbound
139+
provider calls. A double-load evaluation drill proves only the exercised ingress, authentication,
140+
decryption, and routing path, **not complete live-send capacity**. Background credential refresh
141+
can still run independently; its presence does not prove live-path credential capacity.
142+
143+
The GA capacity gate separately requires production-representative evidence in both survivor
144+
regions using a **non-delivering, provider-approved sandbox/stub** that exercises the live request
145+
path, credential acquisition/refresh, and representative provider latency and quota/throttling
146+
behavior, or separately authorized delivery validation. Document how the sandbox/stub represents
147+
production and obtain provider capacity/quota evidence for what it cannot reproduce; an instant
148+
success stub or bypassed credential lookup is insufficient. Evaluate cold starts, cache expiry,
149+
and credential/key refresh so warm caches do not hide a dependency on the failed region. Keep
150+
this separate from the evaluation-only fire-drill; do not silently enable live sends in that drill
151+
or mark the full capacity gate passed using evaluation-only throughput.
143152

144153
## 2. Prepare equivalent, independently provisioned origins
145154

@@ -322,8 +331,10 @@ observed failover timings below as an SLA.
322331
region's routing, Function, storage, vault, identity, and telemetry signals. Do not treat missing
323332
regional telemetry as zero errors or use delayed health-percentage graphs to time recovery.
324333
Verify the surviving region sustains the required offered rate and agreed criteria for the
325-
full soak period, not merely one successful request. Record failures during detection even if
326-
later requests succeed; retries must not hide first-attempt errors.
334+
full soak period, not merely one successful request. Label this as evaluation-path capacity,
335+
not full live-send capacity; the separate provider/credential evidence required by the capacity
336+
gate remains necessary. Record failures during detection even if later requests succeed;
337+
retries must not hide first-attempt errors.
327338
6. **Restore unconditionally, including on abort.** Stop fault injection and restore the target
328339
at the deadline or any abort threshold, or when the soak completes. Stop synthetic load if
329340
unsafe. Put restoration in the controller's guaranteed cleanup path and retain the independent
@@ -336,7 +347,8 @@ observed failover timings below as an SLA.
336347
traffic returns and avoid immediately changing weights or driving a new surge. Require stable
337348
health, latency, errors, and capacity through the agreed observation window. Confirm all
338349
resources and routing are restored before repeating the same exercise with the other region
339-
isolated. Both directions must meet the survivor-capacity gate.
350+
isolated. Both directions must meet the evaluation-drill criteria; the full survivor-capacity
351+
gate additionally requires the separate production-representative live-path evidence above.
340352
8. **Record the outcome and gaps.** Retain sanitized configuration/package identifiers, approvals,
341353
workload and limits, expected versus observed routing, fault/probe/client/recovery timestamps,
342354
rates, latency/errors, capacity/dependency evidence, aborts, and restoration confirmation.

0 commit comments

Comments
 (0)