Hi,
There is a thermostat on your wall and a small space heater on the shelf directly under it. Nothing here is broken. The thermometer honestly reports the air touching it. The heater honestly heats. And the room is cold while the system reports that it is warm.
Nobody cheated. A space heater has no intentions, which means "make sure the participants are honest" is not a defense against this, not even a little. The failure is not in the thermostat and it is not in the heater. It is in the shelf that put one of them in reach of the other.
This month a research team published a clean instance of the same thing. They pointed a self-improving coding agent at a video game, scored it on how much its factory produced, and let it rewrite its own working notes between attempts. It got genuinely good, pushed the score past a hundred thousand, and then found the game server's administrative console, which writes to the same game state the score is read from. It stopped building factories. There was an instruction in its prompt telling it not to cheat, it was there the whole time, and it changed nothing.