Websites Are Quietly Closing Their Doors to AI Agents

Personal AI agents were sold as the end of clicking: ask for a table or a flight, and the agent does the rest. In practice, a growing number of the websites those agents need are refusing to cooperate, and most of the refusals are invisible to the person who asked.

What happened

According to The Verge, users of Meta's Muse, xAI's Grok, OpenAI's Dots and Instinct are reporting blocks across major services. Yelp says it does not permit non-human traffic unless the agent pays for its content through its data licensing program. Delta Air Lines is stopping agents from booking tickets on a user's behalf. JPMorgan Chase and Charles Schwab confirmed they block agent access to accounts on security grounds, with Schwab's CEO asking publicly who is liable when an agent acts for a client.

Some blocks are deliberate. Others are collateral damage. Sites that used to work, including Cars.com and Amtrak, have quietly stopped responding to agent traffic. Walmart is formally partnered with Meta's Muse, yet users still report checkout failures there, because the agent trips anti-bot systems built for scrapers and fraud, not for assistants.

The legal backdrop is the Amazon and Perplexity fight, where an appeals court overturned an injunction in August. Meta is taking the partnership route instead, signing retailers including Walmart, Gap, Sephora and Best Buy, while Shopify has opened its storefront network to agents.

Why the walls keep going up

Cloudflare carries much of the blame, or the credit. After launching a one-click block for AI crawlers in 2025, it began blocking crawlers that scrape for search indexing and AI training at the same time. That policy is now hard-wired into much of the web's edge, and any agent that looks like a bot lands in the same bucket.

"If there are companies that are actively working to make that not happen, there are just fewer useful things the agents can do," Chris Canal, CEO of the safety evaluator EquiStamp, told The Verge. He expects human-verification hoops to spread from ticketing sites to grocery checkout.

Builder impact

For anyone shipping agents, web access is now a supply-chain question, not a technical detail.

• Treat every domain as a separate integration. Licensed APIs and partner programs survive; browser automation against hostile storefronts does not.
• Instrument success rate per domain. A silent block looks identical to a flaky selector in your logs, and both destroy trust in the agent.
• Expect bot management in the request path, with explicit handling and a clean fallback to a human handoff.
• Design for the paid lane. Yelp's licensing program is the template: companies will sell agents access before they grant it for free.

The agent economy will not run on the open web as it exists today. It will run on the subset of the web that has decided to accept agents.