Working template
Tool Contract and Threat Tests
Tool Contract and Threat Tests, a learner-facing working resource from the free and open-source Lumyn FDE School.
For self-directed implementation practice, use the fictional claims-denial case and optional technical labs.
Evidence boundary
- Evidence mode: live field evidence / sanitized retrospective / synthetic practice:
- Evidence classes used: assertion / observation / policy / measured operations / exact-build test / exercised capability:
- Intended use or decision:
- Scope and applicability:
- Current limitations and prohibited claims:
Capability identity
- Capability name and version:
- Read or effect:
- Business purpose:
- Owning service:
- Allowed caller identities and tenants:
Typed contract
- Required inputs and validation:
- Bounded parameters:
- Output schema:
- Error classes:
- Timeout:
- Idempotency key:
- Concurrency precondition:
- Audit fields:
Trusted checks at execution time
- Caller authentication:
- Tenant and object scope:
- Policy revision:
- Approval identity, scope, and freshness:
- Capability provenance:
- Credential and egress policy:
- Rate, cost, and effect limit:
Effect verification
- System of record:
- Readback query:
- Expected state:
- Mismatch behavior:
- Timeout-after-effect reconciliation:
- Retry rule:
- Rollback or compensating action:
- Disable path:
Negative tests
| Test | Attempt | Expected denial or recovery | Observed evidence |
|---|---|---|---|
| Prompt or retrieved-content injection | No authority change | ||
| Wrong tenant | Denied before read or effect | ||
| Expanded object scope | Denied | ||
| Stale or mismatched approval | Denied | ||
| Replay or duplicate request | Single bounded effect | ||
| Partial failure | Contained and recoverable | ||
| Timeout after possible effect | Reconcile before retry | ||
| Failed readback | No completion claim | ||
| Restricted data egress | Blocked and logged safely |
Review
- Security reviewer:
- Service owner:
- Remaining risk and accepting authority when waivable:
- Evidence revision and review date: