Play online math games in agent mode

The author had GPT-5 in ChatGPT agent mode play online versions of Math Games with Bad Drawings, and it mostly worked, unlike earlier rental car and tax form attempts.

What They Did

The author pointed GPT-5 in ChatGPT agent mode at online versions of games from Ben Orlin's Math Games with Bad Drawings. The agent clicked around the game sites in its own browser and chose moves, with its reasoning visible. The author played the opposing side and had to type "your turn" after each move, since the agent couldn't tell when it was its turn.

How It Went

Basically worked, which beat earlier attempts at rental car booking and tax forms. It played poorly, though. The author beat it easily as both Bob and Alice, and it wrongly claimed it could watch for turn changes.

Worth Knowing

The agent can't watch a page for changes, so you have to prompt it every turn. A commenter also noted the games may be in its training data.