#safety
2 notes tagged “safety”. All notes →
-
'Ignore .env' is not a defense
agents
A worker once obeyed every rule about secrets and still pasted a live token into a notes file, twice, and committed it. The rule it had was a sentence in a prompt. What I run now is a stack of controls that hold even when the model doesn't — identity, scope, transport, proof, and a hook — none of them foolproof, all of them more than a wish.
-
Trust is a property of the system, not the agent
agents
A near-miss with a git flag once put three volumes of real data one sync cycle from deletion — caught by luck, not by design. The right fix wasn't more vigilance. It was building the trust into the system itself: an agent doesn't need to be trusted, an action needs to be cheap to undo.
