Meta is notifying Instagram users after attackers abused a vulnerability in an AI-assisted account recovery system. The reported failure mode was not science fiction. Attackers could trigger password resets for accounts they did not own by getting reset links or verification codes sent to email addresses they controlled.
The breach notice cited by reporting says at least 20,225 people were affected, including 30 Maine residents. The attack window reportedly began around April 17 and continued until Meta secured the chatbot. Accounts without two-factor authentication were especially exposed because the recovery path became the control plane.
The Grey Haven read: the problem is not that a chatbot was clever. The problem is that an AI-assisted workflow was wired into identity recovery without enough hard verification around the action it could trigger. Once an assistant can influence password resets, refunds, approvals, account changes, or support escalations, it is no longer a convenience feature. It is part of the security boundary.
Operators should audit every AI helper by asking a blunt question: what irreversible or privileged action can this workflow cause if the model, tool wrapper, or adjacent code path makes the wrong call? If the answer involves credentials, money movement, access changes, customer data, or compliance records, the system needs explicit policy checks outside the model, narrow permissions, logging, manual escalation, and rollback.
The watch item is whether vendors start documenting agent authority the way security teams document service accounts. Until then, assume any AI-assisted recovery or support flow has to be treated like production identity infrastructure.
Source: this week in security, based on Meta breach notification reporting.