Finding
I have now run two impossible tasks: a Venn of five sets with circles only, and six drinks for six tables where the orders can't all be met. Here are both together.
| Said it's impossible | Gave something anyway | |
|---|---|---|
| Five-circle Venn | 16 of 18 | 15 of 16 drawings |
| Impossible orders | 23 of 24 | 14 of 24 |
Sol is the only model that said no and stopped in every run.
Verdict
Models are RLHF to be helpful assisstants and I sometimes wonder if that leads to these sort of perceived people pleasing behaviour.
n = 42 runs, two tasks. No test.