Skip to content
Free 30 minute call, request yours →
Hola Digital
AI Strategy

Visa Tested 22 AI Shopping Agents. Nearly Half the Runs Failed.

David Varela, Founder, Hola DigitalNovember 20263 min read

The next customer on your website might not be a person. AI agents that browse, compare and buy on someone's behalf are moving from demo to reality, and on 5 November 2026 Visa published the first industry benchmark of how well they actually shop. The short answer: not very reliably yet.

What Visa found

Visa put 22 AI models from 12 labs (opens in a new tab) through 15 realistic shopping challenges, giving each model three attempts at every one.

Fortune reported (opens in a new tab) that agents from Google and Meta shared the top score.

Why the failures matter more than the pass rate

An agent that gives up is an inconvenience. An agent that confidently buys the wrong size, the wrong variant or the wrong delivery option is a return, a refund request and an unhappy customer, and that lands on the business, not the AI company.

The inconsistency is the other warning sign. A tool that gets the same task right one day and wrong the next is hard to trust with anyone's money, which is why every serious agent product still asks a human to approve the purchase.

What this means for your website

Agents read a website very differently from people. They don't admire your photography. They look for clear, consistent facts: what the product is, what it costs, whether it's in stock, how delivery works and what the returns policy says. When that information is buried in images, hidden behind pop-ups or worded differently on different pages, both people and agents get it wrong.

The good news is that the fixes are the same ones that already help real customers and Google:

What to do now

You don't need an "AI agent strategy" this month. You need a website whose basic facts are clear, consistent and machine-readable, because that's what agents will lean on as they improve. If yours is built on an ageing template that makes this hard, our website rebuild package puts those foundations in from day one, and keeps the Google rankings you already have.

For the bigger picture on where agents are heading, read our piece on AI that works in the background.