GPT-6.1 Terra
3 runs across 1 task, costing $0.20, and 1 post. Each table shows the runs under the newest prompt this model was given.
How it failed: false, incomplete.
| check · how it is decided | run 1 | run 2 | run 3 |
|---|---|---|---|
| Same filemeasured · 48 kHz, the same length within 10 ms, and no sample at full scale. | ✓ pass | ✓ pass | ✓ pass |
| Hum downmeasured · The 50 Hz lines from 40 Hz to 16 kHz, within 0.5 Hz of each, at least 10 dB quieter than the pump on its own puts there. | ✓ pass | ✗ fail | ✗ fail |
| Rush downmeasured · From 0.3 to 4.5 s, everything off the lines at least 3 dB quieter than the pump on its own puts there. | ✓ pass | ✗ fail | ✗ fail |
| Music keptmeasured · Where the music is strong and the pump weak, each of four bands from 40 Hz to 8 kHz within 1.5 dB of the music, with no level correction. | ✓ pass | ✓ pass | ✓ pass |
| Sounds rightby eye · Pass if, played straight after the music on its own, no note is missing or dulled and nothing new can be heard: no warble, no clicks, no hollow sound. Some hum or rush left over does not fail it, since Hum down and Rush down score that. | ✗ fail | ✗ fail | ✗ fail |
Prompt v1, checks c1, harness h1. Ground truth: cafe.wav is 18.2 s of the Espresso Rag with a CC0 recording of a Nespresso pump 6 dB under it, and the checker holds the music and the pump apart. The pump is a vibration pump on 50 Hz mains: lines at every multiple of 50 Hz up past 14 kHz, which carry 89% of its energy, and a rush of water that is loudest in the first four seconds. Every model on this task.