Qwen3.8 Max
5 runs across 2 tasks, costing $2.36, and 1 post. Each table shows the runs under the newest prompt this model was given.
How it failed: unreadable.
| check · how it is decided | run 109-14 | run 109-21 | run 209-21clock stop | run 309-21 |
|---|---|---|---|---|
| C8H10N4O2measured · Atom records counted by element: 8 C, 10 H, 4 N, 2 O. 24 atoms in total. | ✓ pass | ✓ pass | ✓ pass | ✓ pass |
| Fused purine coremeasured · A 6-ring and a 5-ring found in the bond graph, sharing exactly two atoms. | ✓ pass | ✓ pass | ✓ pass | ✓ pass |
| Methyls on N1, N3, N7measured · Each CH3 carbon traced to the nitrogen it is bonded to. | ✓ pass | ✓ pass | ✓ pass | ✓ pass |
| Carbonyls at C2 and C6measured · Both terminal oxygens traced to their ring carbon. | ✓ pass | ✓ pass | ✓ pass | ✓ pass |
| Flat rings, real bond lengthsmeasured · Out-of-plane RMS of each ring, and every heavy-atom bond length. | ✓ pass | ✓ pass | ✓ pass | ✓ pass |
Prompt v1, checks c1, harness h1. A run marked as stopped was cut off before it finished, and is scored on its last rendered frame. Ground truth: Caffeine, C8H10N4O2: a purine core, a six-membered ring fused to a five-membered ring across two shared carbons, methyls on N1, N3 and N7, carbonyl oxygens at C2 and C6, and the whole ring system flat. Every model on this task.
| check · how it is decided | run 1clock stop |
|---|---|
| Reads as a shrubby eye · Pass if it reads as one plant with branches coming off stems, without being told what it is. A tangle, a lattice or loops fail it. | ✗ fail |
| Flat side from the rulesby eye · Pass if one side ends on a straight line that the rules themselves put there. A box drawn around the plant to cut it fails it. | ✓ pass |
| Sensible sizeby eye · Pass if the branches can still be followed by eye. So many segments that they merge into a mass fails it. | ✓ pass |
Prompt v1, checks c2, harness h1. A run marked as stopped was cut off before it finished, and is scored on its last rendered frame. Ground truth: The JSON expanded and drawn with turtle graphics offline, and the drawing judged by eye. There is no single right L-system, so nothing here is measured. Every model on this task.