I'm seeing a lot of euphoria about how Opus 5.5 is good at TLA+, and this means that all…
Summary
Hillel argues that TLA+ cannot achieve universal software verification because it is fundamentally limited to checking logical formulas over individual system behaviors.
TLA+ operates on individual behaviors.
The system views processes as sequences of states; properties are checked by ensuring every individual behavior satisfies a specific logical formula.
TLA+ sees a system as a set of "behaviors", or possible sequences of states.
Reachability properties remain unexpressible.
TLA+ cannot verify that a user can always perform an action, such as changing a password, because it lacks prefix-based reachability logic.
it's always possible to make P true, even if you don't actually decide to
Hyperproperties require multiple traces.
Because TLA+ only examines one behavior at a time, it cannot verify properties defined over two or more traces, such as information leakage.
We can't do these because TLA+ only looks at one behavior at a time.
Statistical properties are impossible.
Metrics like 95th percentile latency are categorized as hyperproperties and fall outside the scope of TLA+ verification.
Logical formulation is the bottleneck.
Most critical software requirements, like legal compliance or user expectations, cannot be translated into the logical formulas required for verification.
If we don't know how to express a system property as a logical formula, we can't verify it.
Highlights
Hyperproperties: properties that are defined over two or more traces.
The core problem, though, is (1): properties are logical formula. If we don't know how to express a system property as a logical formula, we
Statistical properties: 95% latency is 1ms. Impossible because most of these are hyperproperties.
Possibility and reachability properties: that it's always possible to \make\ P true, even if you don't actually decide to.
it's always possible to \make\ P true, even if you don't actually decide to
Read the original ↗Save to your Sponge
Summarized with Sponge. Quotes are the author’s own words.