shopify ai visibility check
How to check whether ChatGPT, Gemini and Perplexity recommend your Shopify store
A 30-minute method to test if AI assistants mention your Shopify store: the prompts to run, what to record, and how to fix what you find.
Key takeaways
- You can audit your AI visibility with a spreadsheet and about 12 prompts across three kinds of question: category, problem and comparison.
- Record whether the store is mentioned, whether the answer links to you, and whether the facts are correct; a wrong price or policy matters more than a missing mention.
- AI answers vary from run to run, so repeat each prompt and read the pattern rather than a single result.
- Access comes first: OAI-SearchBot must be allowed for ChatGPT search, and your pages must be indexed for Google's AI features.
- Retest monthly with the same prompts so you can tell whether a change helped.
Why check at all
More shoppers now ask an assistant for a recommendation before they open a search results page. Nobody can tell you your exact place in those answers, because there is no ranking report for ChatGPT the way there is for Google Search Console. What you can do is ask the questions your customers ask and write down what comes back.
This takes about 30 minutes and a spreadsheet. The goal is not a score. The goal is a short list of things that are wrong or missing, which you can fix one at a time.
Step 1: build a list of 12 prompts
Write the prompts the way a customer would type them, not the way you would write ad copy. Use three groups of four.
| Group | What it tests | Example (hypothetical candle store) |
|---|---|---|
| Category | Whether you appear for what you sell | What are good soy candles for a gift under $30? |
| Problem | Whether you appear for the reason people buy | Which candle scents work in a small apartment? |
| Comparison and brand | What is said when your name is typed in | Is Northfield Co a good candle brand? What is their return policy? |
Include at least two prompts with your brand name and policies. These are where wrong facts surface, and wrong facts are worse than a missing mention.
Step 2: run them and record the same four things
Open ChatGPT, Gemini, Perplexity and Google in AI Mode if you have access. Run every prompt in each, in a fresh chat so an earlier answer does not color the next one. Log these columns:
- Mentioned? Yes or no. Count a mention only if the store or product is named.
- Linked? Whether the answer links to your site, and to which page.
- Correct? Check price, availability, shipping and returns against your own pages. Mark anything wrong.
- Who else appears? The stores and pages that do get named. These are the pages to study.
Run each prompt three times. Assistants generate answers rather than return a fixed list, so wording and sources move between runs. A store that appears in one of three runs is in a different position from one that appears in all three. Read the pattern, not a single answer.
Step 3: read the results
Sort the log into three piles.
- Not mentioned anywhere. This is normal for a smaller store, and it is not a verdict on your business. It usually points to thin pages or to a source the assistant prefers. Open the pages that do appear and note what they have that yours do not: specific answers, comparison tables, reviews, original photos.
- Mentioned but wrong. Treat these as bugs. Find where the wrong value lives: the product page, the structured data, a feed, an old collection page. Fix the source, not the symptom.
- Mentioned and correct. Note which page was cited. That page is doing something right, so copy its pattern on similar pages.
Step 4: rule out access problems first
If you never appear, check that the assistants can read your pages before you rewrite anything.
- ChatGPT search: OpenAI says sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers. Check your robots.txt, available at
yourstore.com/robots.txt, for a rule that blocks it. Blocking GPTBot only affects training use, not search. - Google: Google says a page must be indexed and eligible to show with a snippet to appear as a supporting link in AI Overviews and AI Mode. Check the URL in Search Console.
- A quick scan: The Shopify SEO check tests whether Google and ChatGPT can read a public store URL. It does not ask ChatGPT about you, so use it for access only.
Our AI crawlers lesson explains what allowing a bot does and does not do. The AEO, GEO and SEO guide covers what to prioritize once access is fine.
What to ignore in the results
Some patterns look important and are not. Knowing which ones to set aside keeps you from rewriting pages for no reason.
- One missing mention. If you appear in two of three runs and vanish in the third, that is normal variation. Only act on patterns that repeat across runs and across assistants.
- Answers that name big marketplaces. For broad category prompts, large retailers often dominate. Your better chance is in specific prompts: a niche, a use case, a gift occasion, a compatibility question.
- Features you cannot verify. Assistants sometimes describe a product detail your page never states. Do not copy the claim onto your page. Check it against your supplier or your own samples, and add it only if it is true.
- Your own searches. If you are logged in or have visited your store before, the assistant may weigh that context. Use a fresh session or a private window to get a fairer read.
Keep notes on what you decided to ignore and why. Next month, when the result changes, you will know whether it changed because of your edits or because the assistant did.
Step 5: fix the gaps, one at a time
Match each finding to one change, and change only a few things per month so you can tell what worked.
| Finding | Change |
|---|---|
| Wrong price or policy quoted | Align the product page, structured data and feed; update the policy page text |
| Competitors cited for your category | Add the buyer questions they answer to your product pages: sizing, compatibility, care, shipping time |
| Vague snippet text | Rewrite the meta title and description to say what the product is; see the meta titles guide |
| Pages not indexed | Fix canonicals and duplicates; see the duplicate content guide |
| Images not described | Add alt text from the product's image menu in admin |
Shopify's help center says Google can rewrite titles and descriptions, and Google says recrawling can take anywhere from several days to several months. Give each change a few weeks before you judge it.
Retest, and where a tool fits
Put a reminder in your calendar to rerun the same 12 prompts monthly and log the results in the same sheet. Using the same prompts is the point: it lets you compare like with like.
If the fixes are mostly SEO housekeeping across many products, an app can take the repetitive part. Rankly, for example, lists an SEO audit with one-click fixes, AI-written meta titles and descriptions, bulk image alt text and FAQ schema, with a free plan of 100 AI credits as of Oct 27, 2026. It is new and has no reviews yet. It speeds up the housekeeping; it does not decide whether an assistant recommends you, so keep the monthly check either way.
Shopify questions
How often should I check AI visibility?
Monthly is enough for most stores. Answers vary between runs and models update, so daily checks mostly measure noise.
Why does ChatGPT give a different answer each time?
AI assistants generate answers rather than retrieve a fixed ranking, so wording and sources can change between runs. Run each prompt a few times and log how often you appear.
What if an assistant states the wrong price or policy?
Check that your product page, structured data and feeds agree, then fix whichever source is stale. Shopify and Google read those sources, and a mismatch leaves room for an old value to be quoted.
Do I need a paid tool to track this?
No. A spreadsheet works for a small set of prompts. Paid trackers help when you have many products or markets and want it automated.
Can I stop AI tools from using my content?
You can disallow training bots such as GPTBot in robots.txt. Blocking OAI-SearchBot also removes you from ChatGPT search answers, so decide on each bot separately.
Rankly is made by Ninety9, the team behind Checkout Club101.