Work note 01 / Adversarial evaluation
2026-08-23We red-teamed our own PHI guardrail, and the logs were the problem.
An LLM guardrail that catches patient identifiers, including base64 and spaced-out digits, held against every injection we threw at it. The finding that mattered was somewhere else entirely.
- Subject
- NHS PII guardrail, FastAPI service, Claude Haiku 4.5 classifier
- Demonstrates
- Failure modes, adversarial testing, socio-technical scope