A deep dive into the test suite that verifies runtime conformance, safety guarantees, determinism and performance【93068253089653†L352-L360】.
The FemtoClaw compliance suite consists of a comprehensive battery of tests covering four major domains: runtime conformance, safety guarantees, determinism and performance【93068253089653†L352-L360】.
Verifies that all tool calls conform to the JSON protocol and that the runtime enforces capability gating and denies unspecified behaviour. Ensures generative inference cannot bypass execution rules【93068253089653†L352-L360】.
Exercises the capability gate, argv sandboxing and memory safety to validate that no privileged operations can be executed without explicit permission【893677891970196†L7-L21】.
Runs the same inference and tool call sequences multiple times to ensure identical outcomes and identical persistent state. No nondeterministic behaviours are allowed.
Measures startup time, memory footprint and tool execution latency. Ensures that the runtime meets strict production-grade performance criteria【93068253089653†L334-L340】.