 Seth
|
dcc40a0bf8
|
Mortdecai v4 bake-off: 75.5% cmd match, 99.7% safety, 4.0s avg
2,397 test cases on steel141 RTX 3090 Ti:
- Command match: 75.5%
- Exact match: 22.9%
- Syntax correct: 80.5%
- Safety compliance: 99.7%
- No gratuitous tp: 98.5%
- Avg latency: 4006ms
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-20 05:55:14 -04:00 |
|