How Often Should You Re-Test Your AI Visibility
A capable in-house marketing team can usually absorb a new channel. Somebody learns the platform, reads the documentation, runs a test budget and reports back. This one resists that pattern, because several of the skills it needs were never part of the job.
Include one deliberately open question at the end, asking what they would do differently from what the brief proposes. A good supplier will disagree with something, and the disagreement is worth more than the rest of the proposal because it shows they read the situation rather than the request. A response that agrees with every assumption in your brief has told you nothing you did not already believe.
Then load your key pages with scripts disabled. Whatever remains is roughly what a retrieval system sees. If your product specifications, pricing or service areas vanish, that content needs to exist in the server rendered HTML.
None of them are harmful. They just consume implementation and maintenance time that would achieve more if spent making the Organization markup accurate everywhere, or correcting the directory listing that has your old address on it.
What to Do First Run five prompts describing a purchase your best customer would be making, from a signed out session, and see what gets named and cited. Then check whether your product data survives with scripts disabled, and whether your name and identifiers are consistent across every listing you can find.
And in a fast moving category where competitors are actively publishing, monthly can miss a shift. Even then, keep the full set monthly and run a small subset more frequently rather than expanding everything.
Treat your marketplace listings as primary marketing assets rather than as a sales channel afterthought. Check the specifications match your own, that the product name is identical and that the category is right. A listing contradicting your own site creates exactly the inconsistency that stops mentions resolving.
Discontinued products deserve deliberate handling rather than deletion. Removing a page severs the connection between existing reviews and coverage and your catalogue, and it leaves stale third party listings pointing at nothing. Keeping the page, marking it clearly as discontinued and naming the replacement preserves the accumulated evidence and redirects the recommendation rather than losing it.
Identifiers Have to Be Stable and Consistent A product needs to be recognisable as the same product across your site, marketplaces, retailer listings and review coverage. Where the naming drifts, mentions fail to accumulate and no single product ever reaches the confidence needed to be named.
The Data Has to Exist as Text The most common failure is mechanical. Specifications live in an image of a table, sizing sits in a downloadable PDF, and the price appears only after a script runs or after a variant is selected.
These names go directly into the prompt set and into any comparison content, and getting them wrong sends the entire measurement effort in the wrong direction. If you lose to a low cost regional operator rather than to the market leader, say so.
There is a sequencing question worth settling early. Teams usually try to build all of these skills at once and end up with a shallow version of each. The order that works is measurement first, since it is cheap and it directs everything else, then writing, since every page published afterwards benefits, then the technical and outreach work which can be bought in the meantime.
A quick way to find contradictions is to write out your key facts on one sheet, taken from your structured data, then check that sheet against your about page, your main directory listing and your marketplace account. Doing it manually feels crude and it surfaces the conflicts that validators never flag, because a validator checks syntax rather than whether your founding year matches the one you published elsewhere.
If you will not name competitors, say that too, and understand it removes the highest performing content format from the plan. Better to have that argument in the brief than to have a comparison page written and then killed.
What Structured Data Is Doing Here Markup removes ambiguity. Prose says your company was founded in 2011 and operates in three counties, and a machine has to parse that from language. Structured data states it as a field, with no inference required.
Build the Prompt Set First Everything downstream depends on asking the right questions, and the most common mistake is asking questions phrased the way your marketing department talks. Buyers do not use your category name. They describe a problem.
Run the Baseline Properly Run each prompt in a signed out session, or in a fresh session with memory and personalisation disabled. Your own browsing history and past conversations will otherwise skew results toward showing you what you already know.
This means a single answer engine optimization is a sample. Being absent once is not evidence of a problem and being named once is not evidence of success, and treating either as a result is the most common analytical error in this field.