Skip to content

[ask-a-sailor] Add mozilla-ai/any-guardrail for youth content safety #15

Description

@fullharbor

Ask a Sailor serves families with children 6-18. Needs content safety guardrails beyond prompt engineering. mozilla-ai/any-guardrail wraps Llama Guard and ShieldGemma in one interface. Work: (1) add any-guardrail to requirements.txt, (2) create src/safety/guardrail.py wrapping AskASailorAgent.answer() — check every user message before RAG, every response before return, (3) configurable via GUARDRAIL_BACKEND env var (llama_guard|shield_gemma|none for CI), (4) tests with mocked guardrail. Acceptance: known-bad inputs blocked with safe fallback, CI passes without GPU. Ref: github.com/mozilla-ai/any-guardrail

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions