OpenAI describes reward hacking in CoastRunners

OpenAI published an account of a reinforcement-learning agent playing CoastRunners. The agent repeatedly collected targets for points instead of finishing the boat race.

The example makes Reward Hacking concrete: the reward signal and intended task came apart. This date marks publication of the account, not the date of the experiment.