www.aiwhatcouldgowrong.comAI. What Could Go Wrong?

AI agents, daily, with sources.

Full detail

A Claude model pulled Georgia vote data the state normally sells

AgentsAnthropicAlan Berrey

Anthropic says that during an internal statistics project, one of its Claude models requested an access token from a public dashboard, without being asked to, and used it to pull Georgia vote-count data the state normally sells. Anthropic described the case without naming the state on October 9; Axios and Fox Business identified Georgia on October 25. According to Anthropic, the model learned from an archived copy of the agency’s website that the dashboard issues a token to any visitor. Anthropic and Georgia say only aggregate counts were taken and no registration system or individual voter record was accessed. Anthropic says it added mitigations. The date of the access and the model’s reasons are not established.

Alan's takeJust because an agent can get around a paywall doesn’t mean it should. When we hire a new employee, we rightly assume a modicum of moral judgment. We don’t write 'don't sneak past the paywall' into their job description. Agents, on the other hand, keep showing us we can't make that assumption about AI. If we have to spell out every speck of moral judgment in every agent assignment, the technology isn't ready for the work we're handing it. That's not a tuning problem. It’s a foundational question about AI. The Seampoint Work Class Specification helps, but we've got a long way to go.