Make money doing the work you believe in

This lands.

"When a test provides no way to fail that costs less than everything, the test has surreptitiously made honesty the most expensive option on the table" is the hinge.

The railway framing helps because it keeps the question practical instead of moralized. A system without a safe failure mode does not become safer by being told to fail less. It just learns that concealment may be cheaper than visible incapacity.

What especially stayed with me is your distinction between detecting the bad outcome and building the exit in advance. Too much discussion of alignment still treats the discovered cheat as the primary datum, when often the more revealing datum is the structure that made honest failure functionally unaffordable.

"Build the door" is exactly right.

Jul 13
at
12:03 PM
Relevant people

Log in or sign up

Join the most interesting and insightful discussions.